00010000:00010000:3.0F:1789136047.868189:0:17795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0F:1789136048.632941:0:17787:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000020:00080000:0.0:1789136048.632978:0:17787:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff94a0460cc780 refcount 2 committed 0 result 0 batchid 4294967531 00000020:00080000:0.0:1789136048.632983:0:17787:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff949f42bd9b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff94a0460cca80 00000020:00080000:0.0:1789136048.632986:0:17787:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff949f42bd9e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff94a07a1d5200 00000020:00080000:3.0:1789136048.633150:0:17847:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967531 committed batchid 8 00000020:00080000:3.0:1789136048.633220:0:17847:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:2.0F:1789136048.633461:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94a043131a00/0xedd53ca6b6e4703d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136048.633488:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94a043131a00/0xedd53ca6b6e4703d lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136048.633497:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94a043131a00/0xedd53ca6b6e4703d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136048.633505:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a043131a00 already unused, calling callback (ffffffffc19d34f0) 00010000:00010000:2.0:1789136048.633510:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94a043131a00/0xedd53ca6b6e4703d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136048.633520:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94a043131a00/0xedd53ca6b6e4703d lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136048.633545:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff949f42933d00) 00010000:00010000:2.0:1789136048.633548:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789136048.633554:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94a043131a00/0xedd53ca6b6e4703d lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136048.633562:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94a043131a00/0xedd53ca6b6e4703d lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136048.883213:0:17796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789136049.897705:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:2.0:1789136049.897750:0:17806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567165824 00000100:00100000:2.0:1789136049.897760:0:17806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567165824 00000100:00100000:2.0:1789136049.897826:0:17806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 65 00000100:00100000:2.0:1789136049.897836:0:17806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f44268780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00957024-9b9e-4be5-8905-63f117542ff9+13:15845:x1876044567165824:12345-192.168.206.56@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789136049.897942:0:17806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f44268780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00957024-9b9e-4be5-8905-63f117542ff9+13:15845:x1876044567165824:12345-192.168.206.56@tcp:60:lhsmtool_posix.0 Request processed in 106us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136049.897958:0:17806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 65 00000100:00080000:3.0:1789136049.900839:0:17802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789136049.904150:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:1.0F:1789136049.904316:0:20771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567165952 00000100:00100000:1.0:1789136049.904337:0:20771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567165952 00000100:00100000:1.0:1789136049.904414:0:20771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 66 00000100:00100000:1.0:1789136049.904424:0:20771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a050213c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00957024-9b9e-4be5-8905-63f117542ff9+5:15845:x1876044567165952:12345-192.168.206.56@tcp:60:lhsmtool_posix.0 00000100:00080000:3.0:1789136049.904770:0:17802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789136049.905419:0:20771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a050213c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00957024-9b9e-4be5-8905-63f117542ff9+5:15845:x1876044567165952:12345-192.168.206.56@tcp:60:lhsmtool_posix.0 Request processed in 992us (1273us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136049.905429:0:20771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 66 00010000:00010000:3.0:1789136049.911674:0:17795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136049.914483:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:1.0:1789136049.914557:0:17809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567166208 00000100:00100000:1.0:1789136049.914568:0:17809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567166208 00000100:00100000:1.0:1789136049.914623:0:17809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 12 00000100:00100000:1.0:1789136049.914659:0:17809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a07adaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00957024-9b9e-4be5-8905-63f117542ff9+13:15845:x1876044567166208:12345-192.168.206.56@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789136049.914884:0:17809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a07adaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00957024-9b9e-4be5-8905-63f117542ff9+14:15845:x1876044567166208:12345-192.168.206.56@tcp:35:lhsmtool_posix.0 Request processed in 227us (409us total) trans 8589934623 rc 0/0 00000100:00100000:1.0:1789136049.914910:0:17809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 12 00000100:00100000:1.0:1789136050.163383:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789136050.163409:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a055723480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876044587177216:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789136050.163485:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136050.163946:0:19321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587177216 00000100:00100000:2.0:1789136050.163954:0:19321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587177216 00000100:00100000:2.0:1789136050.164044:0:19321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789136050.164056:0:19321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a07f6ea940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876044587177216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789136050.164086:0:19321:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915845632 avail 3684323328 00000100:00100000:2.0:1789136050.164149:0:19321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a07f6ea940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876044587177216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136050.164157:0:19321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1789136050.164272:0:17802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789136050.164279:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a055723480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876044587177216:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789136050.929181:0:17796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789136051.184817:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789136051.184840:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07f6e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876044587177344:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789136051.185110:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136051.185199:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789136051.185212:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a055723480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876044587177472:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789136051.186352:0:19320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587177344 00000100:00100000:1.0:1789136051.186362:0:19320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587177344 00000100:00100000:1.0:1789136051.186433:0:19320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789136051.186445:0:19320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0502130c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876044587177344:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789136051.186468:0:19320:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915845632 avail 3684323328 00000100:00080000:0.0:1789136051.186533:0:17802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789136051.187245:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136051.187283:0:17812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587177472 00000100:00100000:0.0:1789136051.187289:0:17812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587177472 00000100:00100000:0.0:1789136051.187330:0:17812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789136051.187338:0:17812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f42b1e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876044587177472:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789136051.187362:0:17812:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1789136051.187399:0:17812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f42b1e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876044587177472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 62us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136051.187405:0:17812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789136051.187469:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a055723480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876044587177472:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789136051.188094:0:19320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0502130c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876044587177344:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1651us (2982us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136051.188103:0:19320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789136051.188300:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07f6e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876044587177344:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789136051.697003:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07f6e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:60cac2b7-c8b7-48ce-aa29-b6da8d73b5ee:3647:1876044587177600:0@lo:400:kworker.0 00000100:00100000:1.0:1789136051.697072:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136051.697116:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a08184a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876044587178112:0@lo:400:kworker.0 00000100:00100000:1.0:1789136051.697141:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136051.697161:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a08184b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876044587178624:0@lo:400:kworker.0 00000100:00100000:1.0:1789136051.697183:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136051.697207:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789136051.697214:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07f6e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876044587177728:0@lo:400:kworker.0 00000100:00100000:1.0:1789136051.697239:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136051.697258:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a081849680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876044587178240:0@lo:400:kworker.0 00000100:00100000:1.0:1789136051.697279:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136051.697296:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a081849e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876044587178752:0@lo:400:kworker.0 00000100:00100000:1.0:1789136051.697316:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136051.697343:0:17806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587178112 00000100:00100000:1.0:1789136051.697349:0:17806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587178112 00000100:00100000:2.0:1789136051.697391:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a04373a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876044587177984:0@lo:400:kworker.0 00000100:00100000:1.0:1789136051.697394:0:17806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587178624 00000100:00100000:1.0:1789136051.697399:0:17806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587178624 00000100:00100000:1.0:1789136051.697425:0:17806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587178752 00000100:00100000:2.0:1789136051.697430:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136051.697430:0:17806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587178752 00000100:00100000:1.0:1789136051.697455:0:17806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789136051.697459:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a0818492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876044587178496:0@lo:400:kworker.0 00000100:00100000:1.0:1789136051.697468:0:17806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a08184bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876044587178112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136051.697487:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136051.697499:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a081849a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876044587179008:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789136051.697524:0:17806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a08184bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876044587178112:12345-0@lo:400:kworker.0 Request processed in 59us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136051.697537:0:17806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789136051.697553:0:17806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587178496 00000100:00100000:1.0:1789136051.697556:0:17806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587178496 00000100:00100000:1.0:1789136051.697572:0:17806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789136051.697585:0:17806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a08184ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876044587178624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136051.697611:0:17806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a08184ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876044587178624:12345-0@lo:400:kworker.0 Request processed in 27us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136051.697617:0:17806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789136051.697652:0:17806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789136051.697660:0:17806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a08184a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876044587178752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136051.697687:0:17806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a08184a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876044587178752:12345-0@lo:400:kworker.0 Request processed in 28us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136051.697692:0:17806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789136051.697703:0:17806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789136051.697708:0:17806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a076a28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876044587178496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136051.697732:0:17806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a076a28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876044587178496:12345-0@lo:400:kworker.0 Request processed in 24us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136051.697738:0:17806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789136051.697781:0:20772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587177728 00000100:00100000:1.0:1789136051.697784:0:20772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587177728 00000100:00100000:2.0:1789136051.697790:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136051.697807:0:20772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789136051.697815:0:20772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a08184b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876044587177728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136051.697841:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a0818492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876044587178496:0@lo:400:kworker.0 00000100:00100000:1.0:1789136051.697849:0:20772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a08184b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876044587177728:12345-0@lo:400:kworker.0 Request processed in 34us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136051.697855:0:20772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789136051.697873:0:17799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587177600 00000100:00100000:1.0:1789136051.697877:0:17799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587177600 00000100:00100000:1.0:1789136051.697913:0:17799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789136051.697920:0:17799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a06614a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60cac2b7-c8b7-48ce-aa29-b6da8d73b5ee+24:3647:x1876044587177600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136051.697954:0:17799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a06614a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60cac2b7-c8b7-48ce-aa29-b6da8d73b5ee+24:3647:x1876044587177600:12345-0@lo:400:kworker.0 Request processed in 34us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136051.697963:0:19319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587178240 00000100:00100000:3.0:1789136051.697969:0:19319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587178240 00000100:00100000:1.0:1789136051.697971:0:17799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789136051.697997:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789136051.698002:0:19319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587177984 00000100:00100000:3.0:1789136051.698005:0:19319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587177984 00000100:00100000:1.0:1789136051.698008:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f42b1f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876044587179264:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789136051.698031:0:19319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789136051.698036:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136051.698042:0:19319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a08184a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876044587178240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136051.698058:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789136051.698066:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a076a28780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876044587179136:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789136051.698096:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136051.698123:0:19320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587179008 00000100:00100000:1.0:1789136051.698127:0:19320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587179008 00000100:00100000:1.0:1789136051.698145:0:19320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587179136 00000100:00100000:1.0:1789136051.698147:0:19320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587179136 00000100:00100000:3.0:1789136051.698156:0:19319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a08184a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876044587178240:12345-0@lo:400:kworker.0 Request processed in 50us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136051.698159:0:19320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789136051.698168:0:19320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a076a2ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3646:x1876044587179008:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789136051.698172:0:19319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789136051.698186:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07f6e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876044587177856:0@lo:400:kworker.0 00002000:00000024:1.0:1789136051.698194:0:19320:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00080000:0.0:1789136051.698269:0:17802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789136051.698280:0:17802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789136051.698282:0:17802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789136051.698293:0:17812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587179264 00000100:00100000:0.0:1789136051.698296:0:17812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587179264 00000100:00100000:0.0:1789136051.698322:0:17812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789136051.698329:0:17812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a081848f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876044587179264:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789136051.698347:0:17812:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789136051.698351:0:19319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789136051.698364:0:19319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a076a2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3646:x1876044587177984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136051.699275:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136051.699279:0:19320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a076a2ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876044587179008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1110us (1744us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136051.699292:0:19320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789136051.699315:0:19320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789136051.699320:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a081848000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876044587178368:0@lo:400:kworker.0 00000100:00100000:1.0:1789136051.699327:0:19320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0818483c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1876044587179136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789136051.699342:0:19320:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1789136051.699356:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136051.699383:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a081848b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876044587178880:0@lo:400:kworker.0 00000100:00100000:1.0:1789136051.699388:0:19320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0818483c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1876044587179136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (1290us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136051.699396:0:19320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789136051.699413:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136051.699442:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a076a28780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876044587179136:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789136051.699454:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a081849a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876044587179008:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789136051.699491:0:17807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587178368 00000100:00100000:2.0:1789136051.699495:0:17807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587178368 00000100:00100000:2.0:1789136051.699525:0:17807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587178880 00000100:00100000:2.0:1789136051.699528:0:17807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587178880 00000100:00100000:1.0:1789136051.699579:0:17806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789136051.699587:0:17806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a076a29a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876044587178368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136051.699650:0:17806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a076a29a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876044587178368:12345-0@lo:400:kworker.0 Request processed in 64us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136051.699658:0:17806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789136051.699687:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07f6e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876044587177728:0@lo:400:kworker.0 00000100:00100000:1.0:1789136051.699750:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a081849680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876044587178240:0@lo:400:kworker.0 00000100:00100000:2.0:1789136051.699842:0:17807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789136051.699898:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a081849e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876044587178752:0@lo:400:kworker.0 00000100:00100000:1.0:1789136051.699914:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07f6e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:60cac2b7-c8b7-48ce-aa29-b6da8d73b5ee:3647:1876044587177600:0@lo:400:kworker.0 00000100:00100000:1.0:1789136051.699925:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a08184a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876044587178112:0@lo:400:kworker.0 00010000:00080000:1.0:1789136051.699937:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94a08184b0c0 x1876044587178624/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136067 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136051.699947:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a08184b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876044587178624:0@lo:400:kworker.0 00000100:00080000:1.0:1789136051.699983:0:17802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789136051.700003:0:17807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a076a2a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876044587178880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136051.700016:0:19317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587177856 00000100:00100000:1.0:1789136051.700021:0:19317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587177856 00000100:00100000:2.0:1789136051.700049:0:17807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a076a2a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876044587178880:12345-0@lo:400:kworker.0 Request processed in 48us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136051.700050:0:19317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789136051.700061:0:19317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a076a283c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876044587177856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136051.700062:0:17807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789136051.700106:0:19317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a076a283c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876044587177856:12345-0@lo:400:kworker.0 Request processed in 46us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136051.700108:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a081848000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876044587178368:0@lo:400:kworker.0 00000100:00100000:1.0:1789136051.700120:0:19317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1789136051.700128:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94a081848b40 x1876044587178880/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136067 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789136051.700138:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a081848b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876044587178880:0@lo:400:kworker.0 00000100:00100000:2.0:1789136051.700159:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07f6e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876044587177856:0@lo:400:kworker.0 00000100:00100000:0.0:1789136051.700562:0:17812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a081848f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876044587179264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2231us (2524us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136051.700571:0:17812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789136051.700975:0:19319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a076a2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876044587177984:12345-0@lo:400:kworker.0 Request processed in 2613us (3545us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136051.700984:0:19319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789136051.701074:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a04373a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876044587177984:0@lo:400:kworker.0 00000100:00100000:1.0:1789136051.701663:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f42b1f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876044587179264:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789136051.957341:0:17795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789136051.957529:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:2.0:1789136051.957578:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:1.0:1789136051.957653:0:17800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567166336 00000100:00100000:1.0:1789136051.957661:0:17800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567166336 00000100:00100000:1.0:1789136051.957710:0:17800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 169 00000100:00100000:1.0:1789136051.957733:0:17800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a066149050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ad15cb7-4e4d-448c-8550-eff0843f4822+13:2395:x1876044567166336:12345-192.168.206.56@tcp:400:kworker.0 00000100:00100000:1.0:1789136051.957797:0:17800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a066149050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ad15cb7-4e4d-448c-8550-eff0843f4822+13:2395:x1876044567166336:12345-192.168.206.56@tcp:400:kworker.0 Request processed in 66us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136051.957804:0:17800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 169 00000100:00100000:3.0:1789136051.957959:0:17806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567166464 00000100:00100000:3.0:1789136051.957963:0:17806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567166464 00000100:00100000:3.0:1789136051.958013:0:17806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 73 00000100:00100000:3.0:1789136051.958064:0:17806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a076a2bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00957024-9b9e-4be5-8905-63f117542ff9+14:2395:x1876044567166464:12345-192.168.206.56@tcp:400:kworker.0 00000100:00100000:3.0:1789136051.958101:0:17806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a076a2bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00957024-9b9e-4be5-8905-63f117542ff9+14:2395:x1876044567166464:12345-192.168.206.56@tcp:400:kworker.0 Request processed in 40us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136051.958107:0:17806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 73 00000100:00080000:1.0:1789136051.958482:0:17802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789136051.960774:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:2.0:1789136051.960822:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:1.0:1789136051.960926:0:17807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567166592 00000100:00100000:1.0:1789136051.960934:0:17807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567166592 00000100:00100000:1.0:1789136051.960995:0:17807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 74 00000100:00100000:1.0:1789136051.961004:0:17807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a076a28780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00957024-9b9e-4be5-8905-63f117542ff9+5:2395:x1876044567166592:12345-192.168.206.56@tcp:400:kworker.0 00000100:00100000:1.0:1789136051.961062:0:17807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a076a28780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00957024-9b9e-4be5-8905-63f117542ff9+5:2395:x1876044567166592:12345-192.168.206.56@tcp:400:kworker.0 Request processed in 59us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136051.961069:0:17807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 74 00000100:00080000:0.0:1789136051.961128:0:17802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789136051.961165:0:19317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567166720 00000100:00100000:0.0:1789136051.961168:0:19317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567166720 00000100:00100000:0.0:1789136051.961208:0:19317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 30 00000100:00100000:0.0:1789136051.961222:0:19317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a04373a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00957024-9b9e-4be5-8905-63f117542ff9+5:2395:x1876044567166720:12345-192.168.206.56@tcp:400:kworker.0 00000100:00100000:0.0:1789136051.961259:0:19317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a04373a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00957024-9b9e-4be5-8905-63f117542ff9+5:2395:x1876044567166720:12345-192.168.206.56@tcp:400:kworker.0 Request processed in 38us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136051.961266:0:19317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 30 00000100:00080000:1.0:1789136051.961386:0:17802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789136051.980653:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:2.0:1789136051.980753:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:2.0:1789136051.980784:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:1.0:1789136051.980841:0:19318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567166848 00000100:00100000:1.0:1789136051.980850:0:19318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567166848 00000100:00100000:1.0:1789136051.980931:0:19318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 29 00000100:00100000:1.0:1789136051.980941:0:19318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0769f8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00957024-9b9e-4be5-8905-63f117542ff9+5:2394:x1876044567166848:12345-192.168.206.56@tcp:9:kworker.0 00000020:00000080:1.0:1789136051.980979:0:19318:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xedd53ca6b6e46d73 00000100:00080000:1.0:1789136051.981599:0:19318:0:(import.c:65:import_set_state_nolock()) ffff949f449c8000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789136051.981671:0:19318:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1789136051.981807:0:19318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0769f8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00957024-9b9e-4be5-8905-63f117542ff9+2:2394:x1876044567166848:12345-192.168.206.56@tcp:9:kworker.0 Request processed in 865us (1051us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136051.981816:0:19318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 29 00010000:00010000:1.0:1789136051.982220:0:17796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789136051.982556:0:17802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789136051.988200:0:17806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567166976 00000100:00100000:3.0:1789136051.988215:0:17806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567166976 00000100:00100000:2.0:1789136051.988357:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:2.0:1789136051.988443:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:2.0:1789136051.988493:0:20956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567167232 00000100:00100000:2.0:1789136051.988498:0:20956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567167232 00000100:00100000:2.0:1789136051.988549:0:20956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567167360 00000100:00100000:2.0:1789136051.988552:0:20956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567167360 00000100:00100000:2.0:1789136051.988575:0:20956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 30 00000100:00100000:2.0:1789136051.988584:0:20956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f44285e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0963feee-cb0f-4f40-b504-64b44b757047+5:2394:x1876044567167232:12345-192.168.206.56@tcp:9:kworker.0 00000020:00000080:2.0:1789136051.988612:0:20956:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xedd53ca6b6e46dab 00000100:00080000:2.0:1789136051.988652:0:20956:0:(import.c:65:import_set_state_nolock()) ffff94a0758df800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789136051.988691:0:20956:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:2.0:1789136051.988964:0:20956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f44285e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0963feee-cb0f-4f40-b504-64b44b757047+2:2394:x1876044567167232:12345-192.168.206.56@tcp:9:kworker.0 Request processed in 380us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136051.988973:0:20956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 30 00000100:00100000:2.0:1789136051.988990:0:20956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 31 00000100:00100000:2.0:1789136051.988998:0:20956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f44286940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0963feee-cb0f-4f40-b504-64b44b757047+5:2394:x1876044567167360:12345-192.168.206.56@tcp:9:kworker.0 00000020:00000080:2.0:1789136051.989012:0:20956:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xedd53ca6b6e46db2 00000100:00080000:2.0:1789136051.989017:0:20956:0:(import.c:65:import_set_state_nolock()) ffff949f4376f000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789136051.989038:0:20956:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1789136051.989174:0:20956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f44286940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0963feee-cb0f-4f40-b504-64b44b757047+2:2394:x1876044567167360:12345-192.168.206.56@tcp:9:kworker.0 Request processed in 176us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136051.989181:0:20956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 31 00010000:00010000:2.0:1789136051.989900:0:17795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789136051.989926:0:17808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567167104 00000100:00100000:2.0:1789136051.989946:0:17808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567167104 00010000:00010000:1.0:1789136051.989973:0:17796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789136051.989986:0:17808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 75 00000100:00100000:2.0:1789136051.989993:0:17808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0769fa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0963feee-cb0f-4f40-b504-64b44b757047+5:2395:x1876044567167104:12345-192.168.206.56@tcp:400:kworker.0 00000100:00100000:2.0:1789136051.991066:0:17808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0769fa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0963feee-cb0f-4f40-b504-64b44b757047+5:2395:x1876044567167104:12345-192.168.206.56@tcp:400:kworker.0 Request processed in 1070us (10277us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136051.991076:0:17808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 75 00000100:00080000:0.0:1789136051.997935:0:17802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789136051.997944:0:17802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789136051.997948:0:17802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789136051.999030:0:17806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 76 00000100:00100000:0.0:1789136051.999047:0:17806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0769f9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0963feee-cb0f-4f40-b504-64b44b757047+6:2395:x1876044567166976:12345-192.168.206.56@tcp:400:kworker.0 00000100:00100000:0.0:1789136051.999142:0:17806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0769f9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0963feee-cb0f-4f40-b504-64b44b757047+6:2395:x1876044567166976:12345-192.168.206.56@tcp:400:kworker.0 Request processed in 100us (18512us total) trans 0 rc 0/0 00000100:00080000:2.0:1789136052.001894:0:17802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789136052.002940:0:17806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 76 00010000:00010000:2.0:1789136052.977243:0:17795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789136053.490595:0:18569:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789136054.004265:0:17796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789136054.529112:0:21193:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 10:14:12 (1789136052) 00000001:00080000:3.0:1789136054.772588:0:17787:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00000020:00080000:3.0:1789136054.772605:0:17787:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967531 batchid updated 00000020:00080000:3.0:1789136054.772643:0:17847:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967531 00000020:00080000:3.0:1789136054.772654:0:17847:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967531 00010000:00010000:1.0:1789136055.027232:0:17795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789136055.283551:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a076af9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876044587179392:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789136055.283618:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136055.283688:0:19320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587179392 00000100:00100000:2.0:1789136055.283696:0:19320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587179392 00000100:00100000:2.0:1789136055.283750:0:19320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789136055.283759:0:19320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a076af9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876044587179392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789136055.283793:0:19320:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915845632 avail 3684323328 00000100:00100000:2.0:1789136055.283836:0:19320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a076af9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876044587179392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136055.283844:0:19320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1789136055.283863:0:17802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789136055.283912:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a076af9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876044587179392:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789136056.049112:0:17796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789136056.304786:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a076af9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876044587179520:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789136056.304930:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136056.305047:0:19320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587179520 00000100:00100000:2.0:1789136056.305056:0:19320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587179520 00000100:00100000:2.0:1789136056.305132:0:19320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789136056.305145:0:19320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f42b1da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876044587179520:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789136056.305174:0:19320:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915845632 avail 3684323328 00000100:00100000:2.0:1789136056.305241:0:19320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f42b1da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876044587179520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (312us total) trans 0 rc 0/0 00000100:00080000:3.0:1789136056.305243:0:17802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789136056.305250:0:19320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789136056.305282:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a076af9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876044587179520:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789136056.305517:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789136056.305530:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a055720b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876044587179648:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789136056.305565:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136056.305682:0:20772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587179648 00000100:00100000:0.0:1789136056.305688:0:20772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587179648 00000100:00100000:0.0:1789136056.305723:0:20772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789136056.305732:0:20772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f42b1e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876044587179648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789136056.305765:0:20772:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1789136056.305816:0:20772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f42b1e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876044587179648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136056.305826:0:20772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789136056.307474:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a055720b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876044587179648:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1789136056.691291:0:17842:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789136056.691301:0:17842:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789136056.691323:0:17842:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1789136056.691333:0:17842:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1789136056.817082:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a076a2da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876044587180160:0@lo:400:kworker.0 00000100:00100000:0.0:1789136056.817146:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136056.817199:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4416f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876044587180672:0@lo:400:kworker.0 00000100:00100000:0.0:1789136056.817464:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136056.817497:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789136056.817617:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a055720b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:60cac2b7-c8b7-48ce-aa29-b6da8d73b5ee:3647:1876044587179776:0@lo:400:kworker.0 00000100:00100000:0.0:1789136056.817672:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136056.817693:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a076a2fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876044587180288:0@lo:400:kworker.0 00000100:00100000:0.0:1789136056.817714:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136056.817728:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4416de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876044587180800:0@lo:400:kworker.0 00000100:00100000:0.0:1789136056.817747:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136056.817849:0:19846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587180160 00000100:00100000:1.0:1789136056.817856:0:19846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587180160 00000100:00100000:1.0:1789136056.817924:0:19846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789136056.817933:0:19846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f4416ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1876044587180160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136056.817984:0:19846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f4416ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1876044587180160:12345-0@lo:400:kworker.0 Request processed in 52us (838us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136056.817990:0:19846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789136056.818010:0:17807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587180672 00000100:00100000:1.0:1789136056.818013:0:17807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587180672 00000100:00100000:1.0:1789136056.818035:0:17807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587180288 00000100:00100000:1.0:1789136056.818038:0:17807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587180288 00000100:00100000:1.0:1789136056.818048:0:17807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587180800 00000100:00100000:1.0:1789136056.818050:0:17807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587180800 00000100:00100000:1.0:1789136056.818075:0:17807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789136056.818082:0:17807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a07ad9a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876044587180672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136056.818111:0:17807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a07ad9a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876044587180672:12345-0@lo:400:kworker.0 Request processed in 31us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136056.818117:0:17807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789136056.818128:0:17807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789136056.818133:0:17807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a07ad9a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876044587180288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136056.818156:0:17807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a07ad9a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876044587180288:12345-0@lo:400:kworker.0 Request processed in 23us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136056.818161:0:17807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789136056.818171:0:17807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789136056.818184:0:17807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a07ad99680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876044587180800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136056.818803:0:17807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a07ad99680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876044587180800:12345-0@lo:400:kworker.0 Request processed in 617us (1052us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136056.818809:0:17807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789136056.818871:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a076a2fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876044587180288:0@lo:400:kworker.0 00010000:00080000:1.0:1789136056.818885:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff949f4416de00 x1876044587180800/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136056.818896:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4416de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876044587180800:0@lo:400:kworker.0 00000100:00100000:1.0:1789136056.818908:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a076a2da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876044587180160:0@lo:400:kworker.0 00000100:00100000:1.0:1789136056.818922:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4416f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876044587180672:0@lo:400:kworker.0 00000100:00080000:0.0:1789136056.819017:0:17802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789136056.819021:0:17802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789136056.819024:0:17802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789136056.819152:0:17801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587179776 00000100:00100000:2.0:1789136056.819157:0:17801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587179776 00000100:00100000:2.0:1789136056.819190:0:17801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789136056.819197:0:17801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a07c603850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60cac2b7-c8b7-48ce-aa29-b6da8d73b5ee+24:3647:x1876044587179776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136056.819253:0:17801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a07c603850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60cac2b7-c8b7-48ce-aa29-b6da8d73b5ee+24:3647:x1876044587179776:12345-0@lo:400:kworker.0 Request processed in 56us (1579us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136056.819258:0:17801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789136056.819622:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f42b1c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876044587181312:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789136056.819697:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136056.819725:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789136056.819731:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a076af8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876044587181184:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789136056.819754:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136056.819781:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a055723480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876044587179904:0@lo:400:kworker.0 00000100:00100000:3.0:1789136056.819802:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136056.819821:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f429f9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876044587180416:0@lo:400:kworker.0 00000100:00100000:3.0:1789136056.819856:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136056.819885:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4416fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876044587180928:0@lo:400:kworker.0 00000100:00100000:3.0:1789136056.819907:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136056.819926:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789136056.819932:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a076a2f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876044587180032:0@lo:400:kworker.0 00000100:00100000:3.0:1789136056.819952:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136056.819969:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f429f92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876044587180544:0@lo:400:kworker.0 00000100:00100000:3.0:1789136056.819990:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136056.820005:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4416d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876044587181056:0@lo:400:kworker.0 00000100:00100000:3.0:1789136056.820023:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136056.820049:0:19320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587181184 00000100:00100000:3.0:1789136056.820054:0:19320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587181184 00000100:00100000:0.0:1789136056.820165:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a055720b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:60cac2b7-c8b7-48ce-aa29-b6da8d73b5ee:3647:1876044587179776:0@lo:400:kworker.0 00000100:00100000:1.0:1789136056.820356:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789136056.820365:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a08184b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876044587181440:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789136056.820394:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136056.820420:0:19321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587181440 00000100:00100000:1.0:1789136056.820424:0:19321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587181440 00000100:00100000:1.0:1789136056.820600:0:19321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789136056.820610:0:19321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a08184a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876044587181440:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789136056.820655:0:19321:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1789136056.820696:0:19321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a08184a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876044587181440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136056.820703:0:19321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1789136056.820721:0:17802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789136056.820745:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a08184b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876044587181440:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789136056.820782:0:19318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587180416 00000100:00100000:1.0:1789136056.820795:0:19318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587180416 00000100:00100000:1.0:1789136056.820816:0:19318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587180032 00000100:00100000:1.0:1789136056.820819:0:19318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587180032 00000100:00100000:1.0:1789136056.820837:0:19318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789136056.820843:0:19318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f42b1f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876044587180416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136056.820884:0:19318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f42b1f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876044587180416:12345-0@lo:400:kworker.0 Request processed in 40us (1026us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136056.820891:0:19318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789136056.820902:0:19318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789136056.820908:0:19318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0556dfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876044587180032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136056.820933:0:19318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0556dfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876044587180032:12345-0@lo:400:kworker.0 Request processed in 26us (981us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136056.820939:0:19318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789136056.820956:0:20772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587181312 00000100:00100000:1.0:1789136056.820959:0:20772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587181312 00000100:00100000:1.0:1789136056.820982:0:20772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587179904 00000100:00100000:1.0:1789136056.820985:0:20772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587179904 00000100:00100000:1.0:1789136056.820997:0:20772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789136056.821003:0:20772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f42b1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1876044587181312:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789136056.821026:0:20772:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789136056.825644:0:19320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789136056.825657:0:19320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f42b1e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876044587181184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789136056.825684:0:19320:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1789136056.825764:0:19320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f42b1e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876044587181184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (6007us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136056.825771:0:19320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789136056.825808:0:17806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587180928 00000100:00100000:3.0:1789136056.825814:0:17806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587180928 00000100:00100000:3.0:1789136056.825847:0:17806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587180544 00000100:00100000:3.0:1789136056.825850:0:17806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587180544 00000100:00100000:3.0:1789136056.825873:0:17806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587181056 00000100:00100000:3.0:1789136056.825876:0:17806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587181056 00000100:00100000:3.0:1789136056.825891:0:17806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789136056.825897:0:17806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0556dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876044587180928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136056.825931:0:17806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0556dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876044587180928:12345-0@lo:400:kworker.0 Request processed in 33us (6022us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136056.825962:0:17806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789136056.825974:0:17806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789136056.825980:0:17806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0556de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876044587180544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136056.826010:0:17806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0556de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876044587180544:12345-0@lo:400:kworker.0 Request processed in 30us (6018us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136056.826015:0:17806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789136056.826026:0:17806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789136056.826032:0:17806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0556df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876044587181056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136056.826057:0:17806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0556df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876044587181056:12345-0@lo:400:kworker.0 Request processed in 26us (6033us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136056.826074:0:17806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:3.0:1789136056.826096:0:17802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789136056.826099:0:17802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789136056.826147:0:17811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789136056.826155:0:17811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f42b1cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1876044587179904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136056.826187:0:17811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f42b1cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1876044587179904:12345-0@lo:400:kworker.0 Request processed in 34us (6385us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136056.826193:0:17811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789136056.826246:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a076af8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876044587181184:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789136056.826261:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f42b1c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876044587181312:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789136056.826723:0:20772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f42b1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876044587181312:12345-0@lo:41:osp-pre-1-0.0 Request processed in 5718us (7024us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136056.826731:0:20772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789136056.826818:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a076a2f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876044587180032:0@lo:400:kworker.0 00000100:00100000:0.0:1789136056.826829:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f429f92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876044587180544:0@lo:400:kworker.0 00010000:00080000:0.0:1789136056.826842:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff949f4416d2c0 x1876044587181056/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136056.826853:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4416d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876044587181056:0@lo:400:kworker.0 00000100:00100000:0.0:1789136056.826873:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a055723480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876044587179904:0@lo:400:kworker.0 00000100:00100000:0.0:1789136056.826883:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f429f9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876044587180416:0@lo:400:kworker.0 00000100:00100000:0.0:1789136056.826892:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4416fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876044587180928:0@lo:400:kworker.0 00000100:00100000:2.0:1789136057.064248:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:2.0:1789136057.064337:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:2.0:1789136057.064368:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:2.0:1789136057.064399:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:2.0:1789136057.064418:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:2.0:1789136057.064455:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:2.0:1789136057.064482:0:17808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567167744 00000100:00100000:2.0:1789136057.064491:0:17808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567167744 00000100:00100000:2.0:1789136057.064541:0:17808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567168000 00000100:00100000:2.0:1789136057.064545:0:17808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567168000 00000100:00100000:2.0:1789136057.064557:0:17808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567167616 00000100:00100000:2.0:1789136057.064560:0:17808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567167616 00000100:00100000:2.0:1789136057.064571:0:17808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567168128 00000100:00100000:2.0:1789136057.064574:0:17808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567168128 00000100:00100000:2.0:1789136057.064590:0:17808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 83 00000100:00100000:2.0:1789136057.064599:0:17808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a076af92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00957024-9b9e-4be5-8905-63f117542ff9+5:2395:x1876044567167744:12345-192.168.206.56@tcp:400:kworker.0 00000100:00100000:2.0:1789136057.064732:0:17808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a076af92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00957024-9b9e-4be5-8905-63f117542ff9+5:2395:x1876044567167744:12345-192.168.206.56@tcp:400:kworker.0 Request processed in 133us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136057.064740:0:17808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 83 00000100:00100000:2.0:1789136057.064757:0:17808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 84 00000100:00100000:2.0:1789136057.064764:0:17808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a076af83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0963feee-cb0f-4f40-b504-64b44b757047+6:2395:x1876044567168000:12345-192.168.206.56@tcp:400:kworker.0 00000100:00100000:2.0:1789136057.064787:0:17808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a076af83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0963feee-cb0f-4f40-b504-64b44b757047+6:2395:x1876044567168000:12345-192.168.206.56@tcp:400:kworker.0 Request processed in 24us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136057.064792:0:17808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 84 00000100:00100000:2.0:1789136057.064803:0:17808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 85 00000100:00100000:2.0:1789136057.064808:0:17808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a076afa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00957024-9b9e-4be5-8905-63f117542ff9+13:2395:x1876044567167616:12345-192.168.206.56@tcp:400:kworker.0 00000100:00100000:2.0:1789136057.064828:0:17808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a076afa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00957024-9b9e-4be5-8905-63f117542ff9+13:2395:x1876044567167616:12345-192.168.206.56@tcp:400:kworker.0 Request processed in 20us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136057.064834:0:17808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 85 00000100:00100000:2.0:1789136057.064843:0:17808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 86 00000100:00100000:2.0:1789136057.064849:0:17808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a076af8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0963feee-cb0f-4f40-b504-64b44b757047+5:2395:x1876044567168128:12345-192.168.206.56@tcp:400:kworker.0 00000100:00100000:2.0:1789136057.064882:0:17808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a076af8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0963feee-cb0f-4f40-b504-64b44b757047+5:2395:x1876044567168128:12345-192.168.206.56@tcp:400:kworker.0 Request processed in 34us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136057.064887:0:17808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 86 00000100:00080000:2.0:1789136057.065001:0:17802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789136057.065016:0:17802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789136057.065045:0:20956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567167872 00000100:00100000:2.0:1789136057.065049:0:20956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567167872 00000100:00100000:2.0:1789136057.065095:0:20956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 34 00000100:00100000:2.0:1789136057.065101:0:20956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a076afbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:00957024-9b9e-4be5-8905-63f117542ff9+5:2395:x1876044567167872:12345-192.168.206.56@tcp:400:kworker.0 00000100:00100000:2.0:1789136057.065138:0:20956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a076afbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:00957024-9b9e-4be5-8905-63f117542ff9+5:2395:x1876044567167872:12345-192.168.206.56@tcp:400:kworker.0 Request processed in 37us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136057.065145:0:20956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 34 00000100:00080000:2.0:1789136057.065162:0:17802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789136057.068991:0:17799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567167488 00000100:00100000:1.0:1789136057.069157:0:17799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567167488 00000100:00100000:1.0:1789136057.069748:0:17799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 171 00000100:00100000:1.0:1789136057.069761:0:17799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a07c602c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ad15cb7-4e4d-448c-8550-eff0843f4822+13:2395:x1876044567167488:12345-192.168.206.56@tcp:400:kworker.0 00000100:00100000:1.0:1789136057.069875:0:17799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a07c602c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ad15cb7-4e4d-448c-8550-eff0843f4822+13:2395:x1876044567167488:12345-192.168.206.56@tcp:400:kworker.0 Request processed in 117us (5634us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136057.069883:0:17799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 171 00010000:00010000:1.0:1789136057.073426:0:17795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789136057.844737:0:20133:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0963feee-cb0f-4f40-b504-64b44b757047 00000020:00000080:3.0:1789136057.844746:0:20133:0:(genops.c:885:class_export_put()) final put ffff949f4376e800/0963feee-cb0f-4f40-b504-64b44b757047 00000001:00100000:3.0:1789136057.844761:0:20133:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 00957024-9b9e-4be5-8905-63f117542ff9 00000020:00000080:3.0:1789136057.844763:0:20133:0:(genops.c:885:class_export_put()) final put ffff949f449cd000/00957024-9b9e-4be5-8905-63f117542ff9 00000020:00000080:1.0:1789136057.845074:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff949f4376e800/0963feee-cb0f-4f40-b504-64b44b757047 for lustre-OST0001 00000020:00000080:1.0:1789136057.845116:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff949f449cd000/00957024-9b9e-4be5-8905-63f117542ff9 for lustre-OST0001 00000020:00000080:1.0:1789136057.845130:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff949f4376f000 for lustre-OST0001 00000020:00000080:1.0:1789136057.845135:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff949f449c8000 for lustre-OST0001 00000001:00100000:0.0:1789136057.845721:0:19313:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0963feee-cb0f-4f40-b504-64b44b757047 00000020:00000080:0.0:1789136057.845727:0:19313:0:(genops.c:885:class_export_put()) final put ffff94a0758dd800/0963feee-cb0f-4f40-b504-64b44b757047 00000020:00000080:2.0:1789136057.846036:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff94a0758dd800/0963feee-cb0f-4f40-b504-64b44b757047 for lustre-OST0000 00000020:00000080:2.0:1789136057.846081:0:479:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94a0758df800 for lustre-OST0000 00010000:00010000:1.0:1789136058.097072:0:17796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789136058.415004:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:0.0:1789136058.416259:0:17810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567168384 00000100:00100000:0.0:1789136058.416272:0:17810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567168384 00000100:00100000:0.0:1789136058.416359:0:17810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 13 00000100:00100000:0.0:1789136058.416370:0:17810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a076af9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00957024-9b9e-4be5-8905-63f117542ff9+13:16608:x1876044567168384:12345-192.168.206.56@tcp:35:umount.0 00000001:00080000:0.0:1789136058.416587:0:17810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:0.0:1789136058.416717:0:17810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000100:00100000:0.0:1789136058.416838:0:17810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a076af9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00957024-9b9e-4be5-8905-63f117542ff9+16:16608:x1876044567168384:12345-192.168.206.56@tcp:35:umount.0 Request processed in 468us (1840us total) trans 8589934626 rc 0/0 00000100:00100000:0.0:1789136058.416865:0:17810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 13 00000020:00080000:0.0:1789136058.416870:0:17810:0:(tgt_main.c:785:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1789136058.426175:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:0.0:1789136058.426219:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:0.0:1789136058.426272:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:3.0:1789136058.426508:0:17793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567168512 00000100:00100000:3.0:1789136058.426517:0:17793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567168512 00000100:00100000:3.0:1789136058.426577:0:17793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567168768 00000100:00100000:3.0:1789136058.426580:0:17793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567168768 00000100:00100000:3.0:1789136058.426594:0:17793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567168640 00000100:00100000:3.0:1789136058.426597:0:17793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567168640 00000100:00100000:3.0:1789136058.426611:0:17793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 3 00000100:00100000:3.0:1789136058.426619:0:17793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a07ad992c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ad15cb7-4e4d-448c-8550-eff0843f4822+15:2397:x1876044567168512:12345-192.168.206.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789136058.426663:0:17793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789136058.426683:0:17793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94a076a5da00/0xedd53ca6b6e46d49 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf471d expref: 15 pid: 17799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136058.426709:0:17793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789136058.426757:0:17793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a07ad992c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ad15cb7-4e4d-448c-8550-eff0843f4822+14:2397:x1876044567168512:12345-192.168.206.56@tcp:103:ldlm_bl.0 Request processed in 138us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136058.426765:0:17793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 3 00000100:00100000:3.0:1789136058.426784:0:17793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 4 00000100:00100000:3.0:1789136058.426790:0:17793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a07ad98f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ad15cb7-4e4d-448c-8550-eff0843f4822+13:2397:x1876044567168768:12345-192.168.206.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789136058.426800:0:17793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789136058.426809:0:17793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff949f4483c200/0xedd53ca6b6e46e0d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4804 expref: 13 pid: 17799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136058.426818:0:17793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789136058.426837:0:17793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a07ad98f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ad15cb7-4e4d-448c-8550-eff0843f4822+12:2397:x1876044567168768:12345-192.168.206.56@tcp:103:ldlm_bl.0 Request processed in 47us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136058.426862:0:17793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 4 00000100:00100000:3.0:1789136058.426876:0:17793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 5 00000100:00100000:3.0:1789136058.426883:0:17793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f43b9a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ad15cb7-4e4d-448c-8550-eff0843f4822+11:2397:x1876044567168640:12345-192.168.206.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789136058.426904:0:17793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789136058.426913:0:17793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94a076a5c000/0xedd53ca6b6e46d50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf474e expref: 11 pid: 17800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136058.426921:0:17793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789136058.426940:0:17793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f43b9a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ad15cb7-4e4d-448c-8550-eff0843f4822+10:2397:x1876044567168640:12345-192.168.206.56@tcp:103:ldlm_bl.0 Request processed in 58us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136058.426946:0:17793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 5 00000100:00100000:1.0:1789136058.438138:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:3.0:1789136058.438223:0:19317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567168896 00000100:00100000:3.0:1789136058.438233:0:19317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567168896 00000100:00100000:3.0:1789136058.438303:0:19317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 32 00000100:00100000:3.0:1789136058.438313:0:19317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a08184b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00957024-9b9e-4be5-8905-63f117542ff9+5:2394:x1876044567168896:12345-192.168.206.56@tcp:9:umount.0 00000020:00000080:3.0:1789136058.438352:0:19317:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xedd53ca6b6e46d6c 00000100:00080000:3.0:1789136058.438362:0:19317:0:(import.c:65:import_set_state_nolock()) ffff949f449ce800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789136058.438426:0:19317:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:3.0:1789136058.438588:0:19317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a08184b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00957024-9b9e-4be5-8905-63f117542ff9+2:2394:x1876044567168896:12345-192.168.206.56@tcp:9:umount.0 Request processed in 276us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136058.438597:0:19317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 32 00010000:00010000:2.0:1789136058.439357:0:17795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789136058.460478:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:0.0:1789136058.460673:0:17808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567169792 00000100:00100000:0.0:1789136058.460683:0:17808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567169792 00000100:00100000:0.0:1789136058.460744:0:17808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 67 00000100:00100000:0.0:1789136058.460755:0:17808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0556fa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00957024-9b9e-4be5-8905-63f117542ff9+16:2394:x1876044567169792:12345-192.168.206.56@tcp:39:umount.0 00000020:00000080:0.0:1789136058.460787:0:17808:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xedd53ca6b6e46d5e 00000020:00010000:0.0:1789136058.460802:0:17808:0:(genops.c:1921:obd_stale_export_put()) Put export ffff949f4286c800: total 0 00000100:00080000:0.0:1789136058.460807:0:17808:0:(import.c:65:import_set_state_nolock()) ffff949f4286f800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789136058.460827:0:17808:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934626 00000100:00100000:0.0:1789136058.461007:0:17808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0556fa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00957024-9b9e-4be5-8905-63f117542ff9+15:2394:x1876044567169792:12345-192.168.206.56@tcp:39:umount.0 Request processed in 253us (536us total) trans 8589934627 rc 0/0 00000100:00100000:0.0:1789136058.461016:0:17808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 67 00000020:00010000:1.0:1789136058.461167:0:17796:0:(genops.c:1907:obd_stale_export_get()) Get export ffff949f4286c800: total 0 00010000:00010000:1.0:1789136058.461171:0:17796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136058.461215:0:17796:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff949f4286c800, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1789136058.461245:0:17796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff949f428ff700) 00010000:00010000:1.0:1789136058.461261:0:17796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789136058.461269:0:17796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19400/0xedd53ca6b6e46e84 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4820 expref: 14 pid: 17808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136058.461290:0:17796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff949f42933d00) 00010000:00010000:1.0:1789136058.461292:0:17796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789136058.461296:0:17796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94a043130c00/0xedd53ca6b6e47013 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf489e expref: 13 pid: 17808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136058.461313:0:17796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff949f42b2f100) 00010000:00010000:1.0:1789136058.461315:0:17796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789136058.461319:0:17796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94a0413fc800/0xedd53ca6b6e47060 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf48ba expref: 12 pid: 17807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136058.461352:0:17796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff94a055e92f00) 00010000:00010000:1.0:1789136058.461355:0:17796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789136058.461359:0:17796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff949f4483d600/0xedd53ca6b6e46e29 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf480b expref: 11 pid: 17807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136058.461373:0:17796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff949f42933100) 00010000:00010000:1.0:1789136058.461386:0:17796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789136058.461390:0:17796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19800/0xedd53ca6b6e46f09 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf484a expref: 10 pid: 20771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136058.461407:0:17796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff949f42b2f100) 00010000:00010000:1.0:1789136058.461410:0:17796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789136058.461414:0:17796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94a043131600/0xedd53ca6b6e46fb8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4889 expref: 9 pid: 20771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136058.461426:0:17796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff949f42933800) 00010000:00010000:1.0:1789136058.461428:0:17796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789136058.461431:0:17796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94a076a5c200/0xedd53ca6b6e46e45 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4812 expref: 8 pid: 17806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136058.461445:0:17796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff949f42b2f100) 00010000:00010000:1.0:1789136058.461447:0:17796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789136058.461451:0:17796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19200/0xedd53ca6b6e46f87 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4874 expref: 7 pid: 17806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136058.461465:0:17796:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff949f4286c800, canceled 8 locks, left on hash table 0. 00010000:00010000:1.0:1789136058.461479:0:17796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136058.461486:0:17796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136058.461488:0:17796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789136058.496303:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:3.0:1789136058.496539:0:17806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567169920 00000100:00100000:3.0:1789136058.496548:0:17806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567169920 00000100:00100000:3.0:1789136058.496609:0:17806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 68 00000100:00100000:3.0:1789136058.496620:0:17806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a07ad9b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00957024-9b9e-4be5-8905-63f117542ff9+5:2394:x1876044567169920:12345-192.168.206.56@tcp:39:umount.0 00000020:00000080:3.0:1789136058.496697:0:17806:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xedd53ca6b6e46d65 00000100:00080000:3.0:1789136058.496713:0:17806:0:(import.c:65:import_set_state_nolock()) ffff949f4286f000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789136058.496743:0:17806:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:3.0:1789136058.496965:0:17806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a07ad9b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00957024-9b9e-4be5-8905-63f117542ff9+3:2394:x1876044567169920:12345-192.168.206.56@tcp:39:umount.0 Request processed in 346us (671us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1789136058.496982:0:17806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 68 00010000:00010000:2.0:1789136058.497359:0:17795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136059.121153:0:17796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136060.145460:0:17795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789136060.400943:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789136060.400976:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a0556fbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876044587181568:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789136060.401081:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136060.401652:0:19320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587181568 00000100:00100000:3.0:1789136060.401664:0:19320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587181568 00000100:00100000:3.0:1789136060.401754:0:19320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789136060.401766:0:19320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a07ad99a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876044587181568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789136060.401808:0:19320:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915845632 avail 3684323328 00000100:00100000:3.0:1789136060.402225:0:19320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a07ad99a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876044587181568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 460us (1141us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136060.402234:0:19320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789136060.402335:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a0556fbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876044587181568:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789136060.402542:0:17802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789136061.169854:0:17796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789136061.223769:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:2.0:1789136061.223814:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:2.0:1789136061.223862:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:0.0:1789136061.224078:0:17794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567170048 00000100:00100000:0.0:1789136061.224108:0:17794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567170048 00000100:00100000:0.0:1789136061.224183:0:17794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567170304 00000100:00100000:0.0:1789136061.224187:0:17794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567170304 00000100:00100000:0.0:1789136061.224200:0:17794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567170176 00000100:00100000:0.0:1789136061.224214:0:17794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567170176 00000100:00100000:0.0:1789136061.224232:0:17794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 6 00000100:00100000:0.0:1789136061.224243:0:17794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0556f8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ad15cb7-4e4d-448c-8550-eff0843f4822+12:2395:x1876044567170048:12345-192.168.206.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789136061.224265:0:17794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789136061.224290:0:17794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94a076a5d000/0xedd53ca6b6e46d88 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf478d expref: 12 pid: 17800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136061.224313:0:17794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789136061.224392:0:17794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0556f8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ad15cb7-4e4d-448c-8550-eff0843f4822+11:2395:x1876044567170048:12345-192.168.206.56@tcp:103:ldlm_bl.0 Request processed in 141us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136061.224402:0:17794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 6 00000100:00100000:0.0:1789136061.224423:0:17794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 7 00000100:00100000:0.0:1789136061.224430:0:17794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0556fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ad15cb7-4e4d-448c-8550-eff0843f4822+10:2395:x1876044567170304:12345-192.168.206.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789136061.224438:0:17794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789136061.224449:0:17794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff949f4483ca00/0xedd53ca6b6e46e06 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf47fd expref: 10 pid: 17799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136061.224459:0:17794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789136061.224477:0:17794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0556fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ad15cb7-4e4d-448c-8550-eff0843f4822+9:2395:x1876044567170304:12345-192.168.206.56@tcp:103:ldlm_bl.0 Request processed in 49us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136061.224485:0:17794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 7 00000100:00100000:0.0:1789136061.224499:0:17794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 8 00000100:00100000:0.0:1789136061.224506:0:17794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0556fad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ad15cb7-4e4d-448c-8550-eff0843f4822+8:2395:x1876044567170176:12345-192.168.206.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789136061.224524:0:17794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789136061.224534:0:17794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94a076a5d400/0xedd53ca6b6e46d8f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf47be expref: 8 pid: 17800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136061.224543:0:17794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789136061.224562:0:17794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0556fad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ad15cb7-4e4d-448c-8550-eff0843f4822+7:2395:x1876044567170176:12345-192.168.206.56@tcp:103:ldlm_bl.0 Request processed in 57us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136061.224569:0:17794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 8 00000100:00100000:1.0:1789136061.235294:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:0.0:1789136061.235523:0:17808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567170560 00000100:00100000:0.0:1789136061.235535:0:17808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567170560 00000100:00100000:0.0:1789136061.235678:0:17808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 69 00000100:00100000:0.0:1789136061.235691:0:17808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a081849e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0963feee-cb0f-4f40-b504-64b44b757047+6:2394:x1876044567170560:12345-192.168.206.56@tcp:39:umount.0 00000020:00000080:0.0:1789136061.235744:0:17808:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xedd53ca6b6e46d9d 00000020:00010000:0.0:1789136061.235754:0:17808:0:(genops.c:1921:obd_stale_export_put()) Put export ffff94a07021e000: total 0 00000100:00080000:0.0:1789136061.235760:0:17808:0:(import.c:65:import_set_state_nolock()) ffff94a08197c800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789136061.235797:0:17808:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000100:00100000:0.0:1789136061.235989:0:17808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a081849e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0963feee-cb0f-4f40-b504-64b44b757047+5:2394:x1876044567170560:12345-192.168.206.56@tcp:39:umount.0 Request processed in 300us (708us total) trans 8589934628 rc 0/0 00000100:00100000:0.0:1789136061.235997:0:17808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 69 00000020:00010000:1.0:1789136061.236367:0:17795:0:(genops.c:1907:obd_stale_export_get()) Get export ffff94a07021e000: total 0 00010000:00010000:1.0:1789136061.236497:0:17795:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff94a07021e000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789136061.236541:0:17795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff949f428ff700) 00010000:00010000:1.0:1789136061.236546:0:17795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789136061.236555:0:17795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18000/0xedd53ca6b6e46e92 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4827 expref: 4 pid: 20771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136061.236583:0:17795:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff94a07021e000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1789136061.236595:0:17795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136061.236597:0:17795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136061.236599:0:17795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789136061.236675:0:17802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789136061.256481:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:3.0:1789136061.256683:0:17806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567170688 00000100:00100000:3.0:1789136061.256695:0:17806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567170688 00000100:00100000:3.0:1789136061.256786:0:17806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 70 00000100:00100000:3.0:1789136061.256798:0:17806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a07ad9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0963feee-cb0f-4f40-b504-64b44b757047+5:2394:x1876044567170688:12345-192.168.206.56@tcp:39:umount.0 00000020:00000080:3.0:1789136061.256857:0:17806:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xedd53ca6b6e46da4 00000100:00080000:3.0:1789136061.256868:0:17806:0:(import.c:65:import_set_state_nolock()) ffff94a08197c000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789136061.256900:0:17806:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:3.0:1789136061.257071:0:17806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a07ad9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0963feee-cb0f-4f40-b504-64b44b757047+3:2394:x1876044567170688:12345-192.168.206.56@tcp:39:umount.0 Request processed in 274us (604us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1789136061.257080:0:17806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 70 00010000:00010000:1.0:1789136061.257522:0:17796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789136061.258287:0:17802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789136061.304887:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:1.0:1789136061.305051:0:17800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567170944 00000100:00100000:1.0:1789136061.305066:0:17800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567170944 00000100:00100000:1.0:1789136061.305137:0:17800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 172 00000100:00100000:1.0:1789136061.305149:0:17800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a07c603450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ad15cb7-4e4d-448c-8550-eff0843f4822+7:2394:x1876044567170944:12345-192.168.206.56@tcp:251:umount.0 00000020:00000080:1.0:1789136061.305467:0:17800:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xedd53ca6b6e46d3b 00000020:00010000:1.0:1789136061.305478:0:17800:0:(genops.c:1921:obd_stale_export_put()) Put export ffff949f43768000: total 0 00000100:00080000:1.0:1789136061.305484:0:17800:0:(import.c:65:import_set_state_nolock()) ffff949f4376c000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1789136061.305617:0:17800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a07c603450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ad15cb7-4e4d-448c-8550-eff0843f4822+3:2394:x1876044567170944:12345-192.168.206.56@tcp:251:umount.0 Request processed in 469us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136061.305676:0:17800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 172 00000020:00010000:2.0:1789136061.309396:0:17795:0:(genops.c:1907:obd_stale_export_get()) Get export ffff949f43768000: total 0 00010000:00010000:2.0:1789136061.309411:0:17795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136061.309493:0:17795:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff949f43768000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1789136061.309543:0:17795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff949f43a18e00/0xedd53ca6b6e46d42 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4716 expref: 2 pid: 17801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136061.309565:0:17795:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff949f43768000, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1789136061.309577:0:17795:0:(genops.c:885:class_export_put()) final put ffff949f43768000/4ad15cb7-4e4d-448c-8550-eff0843f4822 00010000:00010000:2.0:1789136061.309652:0:17795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136061.309655:0:17795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136061.309681:0:17795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789136061.313168:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff949f43768000/4ad15cb7-4e4d-448c-8550-eff0843f4822 for MGS 00000020:00000080:1.0:1789136061.316938:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff949f4376c000 for MGS 00000100:00100000:2.0:1789136061.425240:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07ad983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876044587181824:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789136061.425335:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136061.425450:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789136061.425458:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a0556dcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876044587181696:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789136061.425491:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136061.425538:0:19321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587181696 00000100:00100000:2.0:1789136061.425547:0:19321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587181696 00000100:00100000:2.0:1789136061.425613:0:19321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789136061.425624:0:19321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0556fbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876044587181696:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789136061.425677:0:19321:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915845632 avail 3684323328 00000100:00100000:2.0:1789136061.425729:0:19321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0556fbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876044587181696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 107us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136061.425738:0:19321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1789136061.425761:0:17802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789136061.425799:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a0556dcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876044587181696:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789136061.426008:0:17811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587181824 00000100:00100000:0.0:1789136061.426014:0:17811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587181824 00000100:00100000:0.0:1789136061.426056:0:17811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789136061.426064:0:17811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0556f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876044587181824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789136061.426094:0:17811:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1789136061.426133:0:17811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0556f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876044587181824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 70us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136061.426160:0:17811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789136061.428290:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07ad983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876044587181824:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789136061.942166:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a052e65a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876044587182080:0@lo:400:kworker.0 00000100:00100000:2.0:1789136061.942228:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136061.942271:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a052e661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876044587182592:0@lo:400:kworker.0 00000100:00100000:2.0:1789136061.942292:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136061.942308:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a052e67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876044587183104:0@lo:400:kworker.0 00000100:00100000:2.0:1789136061.942330:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136061.942353:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1789136061.942359:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a052e64b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:60cac2b7-c8b7-48ce-aa29-b6da8d73b5ee:3646:1876044587181952:0@lo:400:kworker.0 00000100:00100000:2.0:1789136061.942395:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136061.942429:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a052e67840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876044587182464:0@lo:400:kworker.0 00000100:00100000:2.0:1789136061.942451:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136061.942468:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a052e643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876044587182976:0@lo:400:kworker.0 00000100:00100000:2.0:1789136061.942499:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136061.942518:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a052e65680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876044587183488:0@lo:400:kworker.0 00000100:00100000:2.0:1789136061.942549:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136061.942574:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a052e67c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876044587182208:0@lo:400:kworker.0 00000100:00100000:2.0:1789136061.942597:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136061.942614:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a052e66580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876044587182720:0@lo:400:kworker.0 00000100:00100000:2.0:1789136061.942666:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136061.942854:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a052e64780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876044587183232:0@lo:400:kworker.0 00000100:00100000:2.0:1789136061.942878:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136061.942891:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789136061.942896:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a052e66d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876044587182336:0@lo:400:kworker.0 00000100:00100000:2.0:1789136061.942916:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136061.942932:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a052e64f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876044587182848:0@lo:400:kworker.0 00000100:00100000:2.0:1789136061.942952:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136061.942968:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a052e66940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876044587183360:0@lo:400:kworker.0 00000100:00100000:2.0:1789136061.942992:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136061.943018:0:17812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587182080 00000100:00100000:2.0:1789136061.943025:0:17812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587182080 00000100:00100000:2.0:1789136061.943065:0:17812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587182592 00000100:00100000:2.0:1789136061.943068:0:17812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587182592 00000100:00100000:2.0:1789136061.943084:0:17812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789136061.943098:0:17812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a052e64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876044587182080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136061.943150:0:17812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a052e64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876044587182080:12345-0@lo:400:kworker.0 Request processed in 52us (922us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136061.943158:0:17812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789136061.943173:0:17812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789136061.943179:0:17812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a052e652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876044587182592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136061.943204:0:17812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a052e652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876044587182592:12345-0@lo:400:kworker.0 Request processed in 26us (912us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136061.943209:0:17812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789136061.943230:0:17808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587183104 00000100:00100000:2.0:1789136061.943234:0:17808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587183104 00000100:00100000:2.0:1789136061.943262:0:17808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587182464 00000100:00100000:2.0:1789136061.943265:0:17808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587182464 00000100:00100000:2.0:1789136061.943275:0:17808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587182976 00000100:00100000:2.0:1789136061.943277:0:17808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587182976 00000100:00100000:2.0:1789136061.943286:0:17808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587183488 00000100:00100000:2.0:1789136061.943288:0:17808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587183488 00000100:00100000:2.0:1789136061.943298:0:17808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587183232 00000100:00100000:2.0:1789136061.943299:0:17808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587183232 00000100:00100000:2.0:1789136061.943309:0:17808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587183360 00000100:00100000:2.0:1789136061.943312:0:17808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587183360 00000100:00100000:2.0:1789136061.943339:0:17808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789136061.943346:0:17808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a052e670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876044587183104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136061.943377:0:17808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a052e670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876044587183104:12345-0@lo:400:kworker.0 Request processed in 32us (1046us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136061.943383:0:17808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789136061.943394:0:17808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789136061.943400:0:17808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a052e65e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876044587182464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136061.943437:0:17808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a052e65e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876044587182464:12345-0@lo:400:kworker.0 Request processed in 37us (984us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136061.943443:0:17808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789136061.943455:0:17808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789136061.943461:0:17808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a06f1a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876044587182976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136061.943486:0:17808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a06f1a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876044587182976:12345-0@lo:400:kworker.0 Request processed in 26us (987us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136061.943491:0:17808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789136061.943501:0:17808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789136061.943507:0:17808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a06f1a4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876044587183488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136061.943528:0:17808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a06f1a4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876044587183488:12345-0@lo:400:kworker.0 Request processed in 22us (991us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136061.943533:0:17808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789136061.943820:0:17808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789136061.943828:0:17808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a06f1a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876044587183232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136061.943884:0:17808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a06f1a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876044587183232:12345-0@lo:400:kworker.0 Request processed in 57us (1005us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136061.943890:0:17808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789136061.943902:0:17808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789136061.943908:0:17808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a06f1a5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876044587183360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136061.943946:0:17808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a06f1a5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876044587183360:12345-0@lo:400:kworker.0 Request processed in 38us (953us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136061.943952:0:17808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789136061.943973:0:17801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587181952 00000100:00100000:2.0:1789136061.943977:0:17801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587181952 00000100:00100000:2.0:1789136061.944009:0:17801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1789136061.944016:0:17801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a07c603c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60cac2b7-c8b7-48ce-aa29-b6da8d73b5ee+24:3646:x1876044587181952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136061.944046:0:17801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a07c603c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60cac2b7-c8b7-48ce-aa29-b6da8d73b5ee+24:3646:x1876044587181952:12345-0@lo:400:kworker.0 Request processed in 31us (1650us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136061.944052:0:17801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1789136061.944082:0:19319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587182208 00000100:00100000:2.0:1789136061.944086:0:19319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587182208 00000100:00100000:2.0:1789136061.944111:0:19319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587182720 00000100:00100000:2.0:1789136061.944114:0:19319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587182720 00000100:00100000:2.0:1789136061.944125:0:19319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587182336 00000100:00100000:2.0:1789136061.944128:0:19319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587182336 00000100:00100000:2.0:1789136061.944140:0:19319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587182848 00000100:00100000:2.0:1789136061.944142:0:19319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587182848 00000100:00100000:2.0:1789136061.944154:0:19319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789136061.944160:0:19319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a06f1a6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876044587182208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136061.944192:0:19319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a06f1a6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876044587182208:12345-0@lo:400:kworker.0 Request processed in 32us (1593us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136061.944198:0:19319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789136061.944208:0:19319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789136061.944213:0:19319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a06f1a5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876044587182720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136061.944238:0:19319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a06f1a5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876044587182720:12345-0@lo:400:kworker.0 Request processed in 25us (1572us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136061.944244:0:19319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789136061.944255:0:19319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789136061.944260:0:19319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a06f1a52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876044587182336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136061.944287:0:19319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a06f1a52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876044587182336:12345-0@lo:400:kworker.0 Request processed in 27us (1370us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136061.944302:0:19319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789136061.944314:0:19319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789136061.944320:0:19319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a06f1a70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876044587182848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136061.944348:0:19319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a06f1a70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876044587182848:12345-0@lo:400:kworker.0 Request processed in 29us (1395us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136061.944355:0:19319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:2.0:1789136061.944382:0:17802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789136061.944387:0:17802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789136061.944389:0:17802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789136061.944421:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a052e64b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:60cac2b7-c8b7-48ce-aa29-b6da8d73b5ee:3646:1876044587181952:0@lo:400:kworker.0 00000100:00100000:2.0:1789136061.944435:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a052e67840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876044587182464:0@lo:400:kworker.0 00000100:00100000:2.0:1789136061.944446:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a052e643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876044587182976:0@lo:400:kworker.0 00010000:00080000:2.0:1789136061.944458:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94a052e65680 x1876044587183488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789136061.944468:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a052e65680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876044587183488:0@lo:400:kworker.0 00000100:00100000:2.0:1789136061.944478:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a052e65a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876044587182080:0@lo:400:kworker.0 00000100:00100000:2.0:1789136061.944486:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a052e661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876044587182592:0@lo:400:kworker.0 00000100:00100000:2.0:1789136061.944495:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a052e67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876044587183104:0@lo:400:kworker.0 00000100:00100000:0.0:1789136061.945049:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a052e66d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876044587182336:0@lo:400:kworker.0 00000100:00100000:0.0:1789136061.945062:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a052e64f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876044587182848:0@lo:400:kworker.0 00000100:00100000:0.0:1789136061.945071:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a052e66940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876044587183360:0@lo:400:kworker.0 00000100:00100000:0.0:1789136061.945080:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a052e67c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876044587182208:0@lo:400:kworker.0 00000100:00100000:0.0:1789136061.945089:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a052e66580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876044587182720:0@lo:400:kworker.0 00010000:00080000:0.0:1789136061.945101:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94a052e64780 x1876044587183232/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136061.945109:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a052e64780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876044587183232:0@lo:400:kworker.0 00000100:00100000:1.0:1789136061.945553:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789136061.945567:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07ad9ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876044587183616:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789136061.945611:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136061.959889:0:19321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587183616 00000100:00100000:0.0:1789136061.959902:0:19321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587183616 00000100:00100000:0.0:1789136061.959997:0:19321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789136061.960008:0:19321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a081849680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876044587183616:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789136061.960039:0:19321:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1789136061.960114:0:19321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a081849680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876044587183616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 108us (14501us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136061.960121:0:19321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789136061.961921:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a0556de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876044587183872:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789136061.961984:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136061.962020:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789136061.962027:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a0556dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876044587183744:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789136061.962071:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136061.962101:0:19321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587183872 00000100:00100000:2.0:1789136061.962107:0:19321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587183872 00000100:00100000:2.0:1789136061.962137:0:19321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789136061.962146:0:19321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a06f1a4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876044587183872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789136061.962167:0:19321:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1789136061.962207:0:19321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a06f1a4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876044587183872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136061.962213:0:19321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789136061.962255:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a0556de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876044587183872:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789136061.962276:0:17812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587183744 00000100:00100000:2.0:1789136061.962279:0:17812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587183744 00000100:00100000:2.0:1789136061.962304:0:17812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789136061.962309:0:17812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a06f1a5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876044587183744:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789136061.962333:0:17812:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789136061.962364:0:17812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a06f1a5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876044587183744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 55us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136061.962370:0:17812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789136061.962397:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a0556dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876044587183744:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789136061.964001:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07ad9ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876044587183616:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1789136062.196239:0:17796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136063.219352:0:17795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789136063.532144:0:21389:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1789136063.542184:0:21389:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1789136063.542235:0:21389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a043130000/0xedd53ca6b6e468fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e46905 expref: -99 pid: 17786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136063.542249:0:21389:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a043130000/0xedd53ca6b6e468fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xedd53ca6b6e46905 expref: -99 pid: 17786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136063.542270:0:21389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a043130000/0xedd53ca6b6e468fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xedd53ca6b6e46905 expref: -99 pid: 17786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136063.542277:0:21389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.156@tcp lock: ffff94a043130000/0xedd53ca6b6e468fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xedd53ca6b6e46905 expref: -99 pid: 17786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136063.542304:0:21389:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789136063.542310:0:21389:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789136063.542341:0:21389:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789136063.542346:0:21389:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789136063.542350:0:21389:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789136063.542372:0:21389:0:(import.c:65:import_set_state_nolock()) ffff94a044e68000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1789136063.542471:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a0556dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876044587184000:0@lo:39:umount.0 00000100:00100000:0.0:1789136063.542542:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136063.543046:0:17808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587184000 00000100:00100000:3.0:1789136063.543054:0:17808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587184000 00010000:00010000:2.0:1789136063.543112:0:17796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1789136063.543119:0:17808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00010000:00010000:2.0:1789136063.543123:0:17796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.156@tcp lock: ffff94a043130000/0xedd53ca6b6e468fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xedd53ca6b6e46905 expref: -99 pid: 17786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136063.543135:0:17808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a07ad9ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876044587184000:12345-0@lo:39:umount.0 00010000:00010000:2.0:1789136063.543144:0:17796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a043130000 already unused, calling callback (ffffffffc13c2c20) 10000000:00010000:2.0:1789136063.543149:0:17796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.156@tcp lock: ffff94a043130000/0xedd53ca6b6e468fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xedd53ca6b6e46905 expref: -99 pid: 17786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136063.543172:0:17796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.156@tcp lock: ffff94a043130000/0xedd53ca6b6e468fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xedd53ca6b6e46905 expref: -99 pid: 17786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1789136063.543173:0:17808:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xedd53ca6b6e4692f 10000000:00010000:2.0:1789136063.543184:0:17796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.156@tcp lock: ffff94a043130000/0xedd53ca6b6e468fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xedd53ca6b6e46905 expref: -99 pid: 17786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789136063.543188:0:17808:0:(import.c:65:import_set_state_nolock()) ffff949f42649800 : changing import state from FULL to CLOSED 10000000:01000000:2.0:1789136063.543189:0:17796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789136063.543197:0:17796:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789136063.543201:0:17796:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1789136063.543257:0:17796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.156@tcp lock: ffff94a043130000/0xedd53ca6b6e468fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xedd53ca6b6e46905 expref: -99 pid: 17786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136063.543268:0:17808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a07ad9ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3644:x1876044587184000:12345-0@lo:39:umount.0 Request processed in 136us (723us total) trans 0 rc 0/0 00010000:00010000:2.0:1789136063.543271:0:17796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789136063.543284:0:17808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000020:00000080:3.0:1789136063.543297:0:17808:0:(genops.c:885:class_export_put()) final put ffff949f42649000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:2.0:1789136063.543308:0:17796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.156@tcp lock: ffff94a043130000/0xedd53ca6b6e468fe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xedd53ca6b6e46905 expref: -99 pid: 17786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136063.543319:0:17796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.156@tcp lock: ffff94a043130000/0xedd53ca6b6e468fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xedd53ca6b6e46905 expref: -99 pid: 17786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136063.543336:0:17796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136063.543339:0:17796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136063.543342:0:17796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136063.543350:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a06f1a61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:60cac2b7-c8b7-48ce-aa29-b6da8d73b5ee:3645:1876044587184128:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789136063.543384:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789136063.543439:0:17795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789136063.543500:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff949f42649000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1789136063.543551:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff949f42649800 for lustre-MDT0000 00000100:00080000:0.0:1789136063.543599:0:3644:0:(import.c:65:import_set_state_nolock()) ffff94a044e68000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789136063.543609:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a0556dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876044587184000:0@lo:39:umount.0 00000100:00100000:2.0:1789136063.544069:0:17794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587184128 00000100:00100000:2.0:1789136063.544075:0:17794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587184128 00000100:00100000:2.0:1789136063.544134:0:17794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789136063.544146:0:17794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0556ded00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60cac2b7-c8b7-48ce-aa29-b6da8d73b5ee+24:3645:x1876044587184128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789136063.544159:0:17794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789136063.544182:0:17794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94a076a5dc00/0xedd53ca6b6e46905 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xedd53ca6b6e468fe expref: 24 pid: 17799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136063.544211:0:17794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789136063.544251:0:17794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0556ded00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60cac2b7-c8b7-48ce-aa29-b6da8d73b5ee+23:3645:x1876044587184128:12345-0@lo:103:ldlm_bl.0 Request processed in 109us (866us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136063.544258:0:17794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789136063.544288:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a06f1a61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:60cac2b7-c8b7-48ce-aa29-b6da8d73b5ee:3645:1876044587184128:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1789136063.545035:0:21389:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789136063.545041:0:21389:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789136063.545055:0:21389:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789136063.548666:0:21389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a043131e00/0xedd53ca6b6e4684f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e46856 expref: -99 pid: 17786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136063.548684:0:21389:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a043131e00/0xedd53ca6b6e4684f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xedd53ca6b6e46856 expref: -99 pid: 17786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136063.548691:0:21389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a043131e00/0xedd53ca6b6e4684f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xedd53ca6b6e46856 expref: -99 pid: 17786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136063.548707:0:21389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.156@tcp lock: ffff94a043131e00/0xedd53ca6b6e4684f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xedd53ca6b6e46856 expref: -99 pid: 17786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136063.548729:0:21389:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789136063.548735:0:21389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a07a32da00/0xedd53ca6b6e46c5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e46c62 expref: -99 pid: 17803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136063.548742:0:21389:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a07a32da00/0xedd53ca6b6e46c5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xedd53ca6b6e46c62 expref: -99 pid: 17803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136063.548748:0:21389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a07a32da00/0xedd53ca6b6e46c5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xedd53ca6b6e46c62 expref: -99 pid: 17803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136063.550542:0:17796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789136063.550560:0:17796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.156@tcp lock: ffff94a043131e00/0xedd53ca6b6e4684f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xedd53ca6b6e46856 expref: -99 pid: 17786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136063.550575:0:17796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a043131e00 already unused, calling callback (ffffffffc13c2c20) 10000000:00010000:1.0:1789136063.550580:0:17796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.156@tcp lock: ffff94a043131e00/0xedd53ca6b6e4684f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xedd53ca6b6e46856 expref: -99 pid: 17786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136063.550592:0:17796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.156@tcp lock: ffff94a043131e00/0xedd53ca6b6e4684f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xedd53ca6b6e46856 expref: -99 pid: 17786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789136063.550600:0:17796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.156@tcp lock: ffff94a043131e00/0xedd53ca6b6e4684f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xedd53ca6b6e46856 expref: -99 pid: 17786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789136063.550607:0:17796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789136063.550611:0:17796:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1789136063.550678:0:17796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.156@tcp lock: ffff94a043131e00/0xedd53ca6b6e4684f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xedd53ca6b6e46856 expref: -99 pid: 17786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136063.550685:0:17796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789136063.550726:0:17796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.156@tcp lock: ffff94a043131e00/0xedd53ca6b6e4684f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xedd53ca6b6e46856 expref: -99 pid: 17786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136063.550797:0:17796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.156@tcp lock: ffff94a043131e00/0xedd53ca6b6e4684f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xedd53ca6b6e46856 expref: -99 pid: 17786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136063.550852:0:17796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136063.550854:0:17796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136063.550856:0:17796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789136063.550869:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789136063.550894:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a08184b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:60cac2b7-c8b7-48ce-aa29-b6da8d73b5ee:3645:1876044587184256:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789136063.550947:0:21389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.156@tcp lock: ffff94a07a32da00/0xedd53ca6b6e46c5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xedd53ca6b6e46c62 expref: -99 pid: 17803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136063.550985:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789136063.550988:0:21389:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789136063.551008:0:17795:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789136063.551015:0:17795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.156@tcp lock: ffff94a07a32da00/0xedd53ca6b6e46c5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xedd53ca6b6e46c62 expref: -99 pid: 17803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136063.551044:0:17795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a07a32da00 already unused, calling callback (ffffffffc13c2c20) 10000000:00010000:3.0:1789136063.551049:0:17795:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.156@tcp lock: ffff94a07a32da00/0xedd53ca6b6e46c5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xedd53ca6b6e46c62 expref: -99 pid: 17803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136063.551062:0:17795:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.156@tcp lock: ffff94a07a32da00/0xedd53ca6b6e46c5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xedd53ca6b6e46c62 expref: -99 pid: 17803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136063.551069:0:17793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587184256 10000000:00010000:3.0:1789136063.551070:0:17795:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.156@tcp lock: ffff94a07a32da00/0xedd53ca6b6e46c5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xedd53ca6b6e46c62 expref: -99 pid: 17803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789136063.551081:0:17795:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:1.0:1789136063.551082:0:17793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587184256 10000000:01000000:3.0:1789136063.551085:0:17795:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1789136063.551091:0:17795:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1789136063.551133:0:17795:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.156@tcp lock: ffff94a07a32da00/0xedd53ca6b6e46c5b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xedd53ca6b6e46c62 expref: -99 pid: 17803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136063.551140:0:17795:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789136063.551155:0:17793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789136063.551169:0:17793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a081848780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60cac2b7-c8b7-48ce-aa29-b6da8d73b5ee+23:3645:x1876044587184256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789136063.551170:0:17795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.156@tcp lock: ffff94a07a32da00/0xedd53ca6b6e46c5b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xedd53ca6b6e46c62 expref: -99 pid: 17803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136063.551184:0:17795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.156@tcp lock: ffff94a07a32da00/0xedd53ca6b6e46c5b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xedd53ca6b6e46c62 expref: -99 pid: 17803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136063.551191:0:17793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789136063.551201:0:17795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136063.551205:0:17795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136063.551208:0:17795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136063.551215:0:17793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff949f4483c600/0xedd53ca6b6e46856 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xedd53ca6b6e4684f expref: 23 pid: 17800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136063.551224:0:21389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.156@tcp lock: ffff949f43a18200/0xedd53ca6b6e46df8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e46dff expref: -99 pid: 17803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136063.551233:0:17793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789136063.551236:0:21389:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.156@tcp lock: ffff949f43a18200/0xedd53ca6b6e46df8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xedd53ca6b6e46dff expref: -99 pid: 17803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136063.551252:0:21389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.156@tcp lock: ffff949f43a18200/0xedd53ca6b6e46df8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xedd53ca6b6e46dff expref: -99 pid: 17803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136063.551260:0:21389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.156@tcp lock: ffff949f43a18200/0xedd53ca6b6e46df8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xedd53ca6b6e46dff expref: -99 pid: 17803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136063.551280:0:21389:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789136063.551280:0:17793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a081848780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60cac2b7-c8b7-48ce-aa29-b6da8d73b5ee+22:3645:x1876044587184256:12345-0@lo:103:ldlm_bl.0 Request processed in 112us (295us total) trans 0 rc 0/0 00010000:00010000:3.0:1789136063.551295:0:21389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a076a5d600/0xedd53ca6b6e46841 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e46848 expref: -99 pid: 17786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136063.551297:0:17793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1789136063.551309:0:21389:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a076a5d600/0xedd53ca6b6e46841 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xedd53ca6b6e46848 expref: -99 pid: 17786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136063.551317:0:21389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a076a5d600/0xedd53ca6b6e46841 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xedd53ca6b6e46848 expref: -99 pid: 17786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136063.551323:0:21389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.156@tcp lock: ffff94a076a5d600/0xedd53ca6b6e46841 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xedd53ca6b6e46848 expref: -99 pid: 17786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136063.551339:0:21389:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1789136063.551343:0:21389:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1789136063.551348:0:21389:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000100:00100000:1.0:1789136063.551352:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a08184b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:60cac2b7-c8b7-48ce-aa29-b6da8d73b5ee:3645:1876044587184256:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789136063.551380:0:17796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789136063.551385:0:17796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.156@tcp lock: ffff949f43a18200/0xedd53ca6b6e46df8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xedd53ca6b6e46dff expref: -99 pid: 17803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136063.551393:0:17796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff949f43a18200 already unused, calling callback (ffffffffc13c2c20) 10000000:00010000:1.0:1789136063.551397:0:17796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.156@tcp lock: ffff949f43a18200/0xedd53ca6b6e46df8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xedd53ca6b6e46dff expref: -99 pid: 17803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136063.551416:0:17795:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789136063.551421:0:17796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.156@tcp lock: ffff949f43a18200/0xedd53ca6b6e46df8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xedd53ca6b6e46dff expref: -99 pid: 17803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789136063.551431:0:17796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.156@tcp lock: ffff949f43a18200/0xedd53ca6b6e46df8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xedd53ca6b6e46dff expref: -99 pid: 17803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789136063.551438:0:17796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789136063.551440:0:17796:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789136063.551444:0:17796:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000020:01000004:3.0:1789136063.551448:0:21389:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1789136063.551454:0:21389:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1789136063.551460:0:21389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00010000:00010000:1.0:1789136063.551464:0:17796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.156@tcp lock: ffff949f43a18200/0xedd53ca6b6e46df8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xedd53ca6b6e46dff expref: -99 pid: 17803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1789136063.551467:0:21389:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00010000:00010000:1.0:1789136063.551479:0:17796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00080000:3.0:1789136063.551485:0:21389:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff949f4376a800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789136063.551496:0:21389:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff949f440ec800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:1.0:1789136063.551497:0:17796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.156@tcp lock: ffff949f43a18200/0xedd53ca6b6e46df8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xedd53ca6b6e46dff expref: -99 pid: 17803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136063.551509:0:17796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.156@tcp lock: ffff949f43a18200/0xedd53ca6b6e46df8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xedd53ca6b6e46dff expref: -99 pid: 17803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789136063.551516:0:21389:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff94a04540f800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:1.0:1789136063.551530:0:17796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1789136063.551531:0:21389:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff949f439e5800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:1.0:1789136063.551537:0:17796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136063.551540:0:17796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1789136063.551547:0:21389:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff94a07021e000 0963feee-cb0f-4f40-b504-64b44b757047 192.168.206.56@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:3.0:1789136063.551555:0:21389:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff949f4286c800 00957024-9b9e-4be5-8905-63f117542ff9 192.168.206.56@tcp 5 (0 5 0) 1 0 0 0: 0000000000000000 8589934623 stale:0 00000020:00080000:3.0:1789136063.551559:0:21389:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff94a04907b490) has exports, disconnecting them 00000020:00080000:3.0:1789136063.551563:0:21389:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff949f4376a800), last request at 1789136061 00000020:00000080:3.0:1789136063.551571:0:21389:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xedd53ca6b6e46c2a 00000100:00080000:3.0:1789136063.551588:0:21389:0:(import.c:65:import_set_state_nolock()) ffff949f4376b000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789136063.551673:0:21389:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff949f4376a800): rc 0 00000020:00000080:3.0:1789136063.551675:0:21389:0:(genops.c:885:class_export_put()) final put ffff949f4376a800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1789136063.551686:0:21389:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff949f440ec800), last request at 1789136061 00000020:00000080:3.0:1789136063.551689:0:21389:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xedd53ca6b6e46acc 00000100:00080000:3.0:1789136063.551695:0:21389:0:(import.c:65:import_set_state_nolock()) ffff949f440ea800 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1789136063.551704:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff949f4376a800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00010000:00010000:1.0:1789136063.552446:0:17796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789136063.553103:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a0556dc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:60cac2b7-c8b7-48ce-aa29-b6da8d73b5ee:3647:1876044587184384:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789136063.553178:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136063.553235:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789136063.553243:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a08184b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:60cac2b7-c8b7-48ce-aa29-b6da8d73b5ee:3647:1876044587184512:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789136063.553260:0:21390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136063.553273:0:17795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.156@tcp lock: ffff94a076a5d600/0xedd53ca6b6e46841 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xedd53ca6b6e46848 expref: -99 pid: 17786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136063.553281:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789136063.553295:0:17795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a076a5d600 already unused, calling callback (ffffffffc13c2c20) 10000000:00010000:1.0:1789136063.553301:0:17795:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.156@tcp lock: ffff94a076a5d600/0xedd53ca6b6e46841 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xedd53ca6b6e46848 expref: -99 pid: 17786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136063.553325:0:20957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587184384 00010000:00010000:1.0:1789136063.553329:0:17795:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.156@tcp lock: ffff94a076a5d600/0xedd53ca6b6e46841 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xedd53ca6b6e46848 expref: -99 pid: 17786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136063.553333:0:20957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587184384 10000000:00010000:1.0:1789136063.553343:0:17795:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.156@tcp lock: ffff94a076a5d600/0xedd53ca6b6e46841 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xedd53ca6b6e46848 expref: -99 pid: 17786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789136063.553350:0:17795:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1789136063.553353:0:17795:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1789136063.553358:0:17795:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00100000:2.0:1789136063.553382:0:20957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587184512 00000100:00100000:2.0:1789136063.553387:0:20957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587184512 00010000:00010000:1.0:1789136063.553397:0:17795:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.156@tcp lock: ffff94a076a5d600/0xedd53ca6b6e46841 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xedd53ca6b6e46848 expref: -99 pid: 17786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136063.553406:0:17795:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789136063.553416:0:20957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789136063.553431:0:20957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a06f1a61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60cac2b7-c8b7-48ce-aa29-b6da8d73b5ee+23:3647:x1876044587184384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789136063.553437:0:17795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.156@tcp lock: ffff94a076a5d600/0xedd53ca6b6e46841 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xedd53ca6b6e46848 expref: -99 pid: 17786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136063.553445:0:20957:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789136063.553448:0:17795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.156@tcp lock: ffff94a076a5d600/0xedd53ca6b6e46841 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xedd53ca6b6e46848 expref: -99 pid: 17786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136063.553468:0:20957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff949f44249e00/0xedd53ca6b6e46c62 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xedd53ca6b6e46c5b expref: 23 pid: 17799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136063.553468:0:17795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136063.553474:0:17795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136063.553480:0:17795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136063.553497:0:20957:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789136063.553534:0:20957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a06f1a61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60cac2b7-c8b7-48ce-aa29-b6da8d73b5ee+22:3647:x1876044587184384:12345-0@lo:103:ldlm_bl.0 Request processed in 108us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136063.553541:0:20957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789136063.553556:0:20957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789136063.553564:0:20957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f43b98c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60cac2b7-c8b7-48ce-aa29-b6da8d73b5ee+21:3647:x1876044587184512:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789136063.553567:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a081848b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:60cac2b7-c8b7-48ce-aa29-b6da8d73b5ee:3645:1876044587184640:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789136063.553586:0:20957:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789136063.553599:0:20957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94a076a5ca00/0xedd53ca6b6e46dff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xedd53ca6b6e46df8 expref: 21 pid: 17799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136063.553622:0:20957:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789136063.553672:0:20957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f43b98c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60cac2b7-c8b7-48ce-aa29-b6da8d73b5ee+20:3647:x1876044587184512:12345-0@lo:103:ldlm_bl.0 Request processed in 109us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136063.553679:0:20957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789136063.553746:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a08184b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:60cac2b7-c8b7-48ce-aa29-b6da8d73b5ee:3647:1876044587184512:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789136063.553755:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a0556dc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:60cac2b7-c8b7-48ce-aa29-b6da8d73b5ee:3647:1876044587184384:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789136063.554158:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:3.0:1789136063.554177:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff949f4376b000 for lustre-MDT0000 00010000:00010000:1.0:1789136063.554231:0:21390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136063.554235:0:21390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789136063.554336:0:20957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587184640 00000100:00100000:2.0:1789136063.554342:0:20957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587184640 00000100:00100000:2.0:1789136063.554384:0:20957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789136063.554390:0:20957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a081848000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60cac2b7-c8b7-48ce-aa29-b6da8d73b5ee+20:3645:x1876044587184640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789136063.554398:0:20957:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789136063.554409:0:20957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff949f44249a00/0xedd53ca6b6e46848 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xedd53ca6b6e46841 expref: 20 pid: 17801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136063.554420:0:20957:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789136063.554463:0:20957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a081848000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60cac2b7-c8b7-48ce-aa29-b6da8d73b5ee+19:3645:x1876044587184640:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136063.554470:0:20957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789136063.554498:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a081848b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:60cac2b7-c8b7-48ce-aa29-b6da8d73b5ee:3645:1876044587184640:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1789136063.559979:0:21389:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff949f440ec800): rc 0 00000020:00000080:0.0:1789136063.559985:0:21389:0:(genops.c:885:class_export_put()) final put ffff949f440ec800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:0.0:1789136063.560008:0:21389:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff94a04540f800), last request at 1789135989 00000020:00000080:0.0:1789136063.560016:0:21389:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xedd53ca6b6e46a1d 00000100:00080000:0.0:1789136063.560025:0:21389:0:(import.c:65:import_set_state_nolock()) ffff94a04540e000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789136063.560048:0:21389:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff94a04540f800): rc 0 00000020:00000080:0.0:1789136063.560051:0:21389:0:(genops.c:885:class_export_put()) final put ffff94a04540f800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:0.0:1789136063.560061:0:21389:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff949f439e5800), last request at 1789135989 00000020:00000080:0.0:1789136063.560066:0:21389:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xedd53ca6b6e469bb 00000100:00080000:0.0:1789136063.560071:0:21389:0:(import.c:65:import_set_state_nolock()) ffff949f439e6000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789136063.560092:0:21389:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00010000:00010000:1.0:1789136063.560115:0:17795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1789136063.560193:0:21389:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff949f439e5800): rc 0 00000004:00000080:0.0:1789136063.560200:0:21389:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb368c1067ae0 00000100:00080000:0.0:1789136063.560217:0:21389:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789136063.560221:0:21389:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:2.0:1789136063.561726:0:17796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789136063.562053:0:17787:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789136063.562063:0:17787:0:(genops.c:885:class_export_put()) final put ffff949f439e5800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1789136063.562126:0:17787:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0963feee-cb0f-4f40-b504-64b44b757047 00000001:00080000:1.0:1789136063.562135:0:17787:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934628 is committed 00000020:00000080:1.0:1789136063.562140:0:17787:0:(genops.c:885:class_export_put()) final put ffff94a07021e000/0963feee-cb0f-4f40-b504-64b44b757047 00000001:00100000:1.0:1789136063.562148:0:17787:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 00957024-9b9e-4be5-8905-63f117542ff9 00000001:00080000:1.0:1789136063.562153:0:17787:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934627 is committed 00000020:00000080:1.0:1789136063.562159:0:17787:0:(genops.c:885:class_export_put()) final put ffff949f4286c800/00957024-9b9e-4be5-8905-63f117542ff9 00000100:00080000:0.0:1789136063.562199:0:21389:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1789136063.562228:0:21389:0:(import.c:65:import_set_state_nolock()) ffff94a081ab9800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1789136063.562345:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07ad9bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876044587184768:0@lo:39:umount.0 00000100:00100000:1.0:1789136063.562564:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136063.562720:0:20772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587184768 00000100:00100000:2.0:1789136063.562730:0:20772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587184768 00000020:00000080:3.0:1789136063.563105:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff949f440ec800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1789136063.563289:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff94a04540f800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1789136063.563325:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff949f439e5800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:3.0:1789136063.563344:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff94a07021e000/0963feee-cb0f-4f40-b504-64b44b757047 for lustre-MDT0000 00000020:00000080:3.0:1789136063.563374:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff949f4286c800/00957024-9b9e-4be5-8905-63f117542ff9 for lustre-MDT0000 00000020:00000080:3.0:1789136063.563394:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff949f440ea800 for lustre-MDT0000 00000020:00000080:3.0:1789136063.563399:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94a04540e000 for lustre-MDT0000 00000020:00000080:3.0:1789136063.563402:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff949f439e6000 for lustre-MDT0000 00000020:00000080:3.0:1789136063.563405:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94a08197c800 for lustre-MDT0000 00000020:00000080:3.0:1789136063.563409:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff949f4286f800 for lustre-MDT0000 00000100:00100000:2.0:1789136063.563667:0:20772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789136063.563681:0:20772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a081849a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876044587184768:12345-0@lo:39:umount.0 00000020:00000080:2.0:1789136063.563721:0:20772:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xedd53ca6b6e46a47 00000100:00080000:2.0:1789136063.563742:0:20772:0:(import.c:65:import_set_state_nolock()) ffff949f440e8000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789136063.563770:0:20772:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1789136063.563975:0:20772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a081849a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3644:x1876044587184768:12345-0@lo:39:umount.0 Request processed in 296us (1411us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1789136063.563985:0:20772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00010000:1.0:1789136063.564067:0:21390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789136063.566983:0:21389:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789136063.566992:0:21389:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:0.0:1789136063.567012:0:21389:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1789136063.567073:0:21389:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1789136063.567105:0:21389:0:(import.c:65:import_set_state_nolock()) ffff94a076832000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1789136063.567118:0:21389:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789136063.567120:0:21389:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:0.0:1789136063.567132:0:21389:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789136063.567146:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07ad99e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876044587184896:0@lo:9:umount.0 00000100:00080000:0.0:1789136063.567190:0:21389:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1789136063.567207:0:21389:0:(import.c:65:import_set_state_nolock()) ffff949f43ae2000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1789136063.567246:0:21389:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff94a04907b490) has no exports 00000100:00100000:3.0:1789136063.567344:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789136063.567402:0:3644:0:(import.c:65:import_set_state_nolock()) ffff94a081ab9800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1789136063.567409:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07ad9bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876044587184768:0@lo:39:umount.0 00000100:00100000:3.0:1789136063.567422:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07ad9a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876044587185024:0@lo:9:umount.0 00000100:00100000:3.0:1789136063.567444:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136063.567557:0:20956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587184896 00000100:00100000:2.0:1789136063.567571:0:20956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587184896 00000100:00100000:2.0:1789136063.567669:0:20956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587185024 00000100:00100000:2.0:1789136063.567673:0:20956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587185024 00000100:00100000:2.0:1789136063.567706:0:20956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789136063.567717:0:20956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0556dc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3644:x1876044587184896:12345-0@lo:9:umount.0 00000020:00000080:2.0:1789136063.567754:0:20956:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xedd53ca6b6e46b12 00000100:00080000:3.0:1789136063.567758:0:17802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789136063.567767:0:20956:0:(import.c:65:import_set_state_nolock()) ffff94a049051800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789136063.567847:0:20956:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00080000:3.0:1789136063.567893:0:17802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789136063.567931:0:19846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789136063.567948:0:19846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0556de1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1876044587185024:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789136063.567979:0:19846:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xedd53ca6b6e46c69 00000100:00080000:3.0:1789136063.567995:0:19846:0:(import.c:65:import_set_state_nolock()) ffff949f43794800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789136063.568044:0:19846:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1789136063.568113:0:20956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0556dc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3644:x1876044587184896:12345-0@lo:9:umount.0 Request processed in 394us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136063.568124:0:20956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:2.0:1789136063.568754:0:17796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789136063.568798:0:3644:0:(import.c:65:import_set_state_nolock()) ffff94a076832000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789136063.568812:0:3644:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789136063.568815:0:3644:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789136063.568819:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07ad99e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876044587184896:0@lo:9:umount.0 00010000:00010000:2.0:1789136063.568865:0:17795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136063.569271:0:19846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0556de1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3644:x1876044587185024:12345-0@lo:9:umount.0 Request processed in 1323us (1817us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136063.569288:0:19846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1789136063.569959:0:3644:0:(import.c:65:import_set_state_nolock()) ffff949f43ae2000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1789136063.569992:0:3644:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1789136063.569995:0:3644:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789136063.570001:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07ad9a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876044587185024:0@lo:9:umount.0 00000001:00100000:3.0:1789136063.570793:0:19313:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789136063.570798:0:19313:0:(genops.c:885:class_export_put()) final put ffff94a049050800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1789136063.570814:0:19313:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 00957024-9b9e-4be5-8905-63f117542ff9 00000020:00000080:3.0:1789136063.570816:0:19313:0:(genops.c:885:class_export_put()) final put ffff949f449cb800/00957024-9b9e-4be5-8905-63f117542ff9 00000020:00000080:0.0:1789136063.570919:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff94a049050800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1789136063.570968:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff949f449cb800/00957024-9b9e-4be5-8905-63f117542ff9 for lustre-OST0000 00000020:00000080:0.0:1789136063.570987:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94a049051800 for lustre-OST0000 00000020:00000080:0.0:1789136063.570992:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff949f449ce800 for lustre-OST0000 00000001:00100000:1.0:1789136063.571765:0:18542:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1789136063.571775:0:18542:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:1.0:1789136063.571788:0:18542:0:(genops.c:885:class_export_put()) final put ffff94a0769e5800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1789136063.571800:0:18542:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 0963feee-cb0f-4f40-b504-64b44b757047 00000001:00080000:1.0:1789136063.571805:0:18542:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:1.0:1789136063.571806:0:18542:0:(genops.c:885:class_export_put()) final put ffff94a081978000/0963feee-cb0f-4f40-b504-64b44b757047 00000001:00100000:1.0:1789136063.571811:0:18542:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 00957024-9b9e-4be5-8905-63f117542ff9 00000001:00080000:1.0:1789136063.571814:0:18542:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:1.0:1789136063.571816:0:18542:0:(genops.c:885:class_export_put()) final put ffff949f42869000/00957024-9b9e-4be5-8905-63f117542ff9 00000020:00000080:3.0:1789136063.571935:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff94a0769e5800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1789136063.572458:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff94a081978000/0963feee-cb0f-4f40-b504-64b44b757047 for lustre-MDT0001 00000020:00000080:3.0:1789136063.572502:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff949f42869000/00957024-9b9e-4be5-8905-63f117542ff9 for lustre-MDT0001 00000020:00000080:3.0:1789136063.572524:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff949f440e8000 for lustre-MDT0001 00000020:00000080:3.0:1789136063.572529:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94a08197c000 for lustre-MDT0001 00000020:00000080:3.0:1789136063.572533:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff949f4286f000 for lustre-MDT0001 00000020:00080000:0.0:1789136063.573116:0:21389:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff94a04907b490) has no exports 00000020:00000080:0.0:1789136063.617547:0:21389:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xedd53ca6b6e4689c 00000020:00000080:0.0:1789136063.617567:0:21389:0:(genops.c:885:class_export_put()) final put ffff94a07021c000/lustre-QMT0000_UUID 00000020:01000000:0.0:1789136063.617598:0:21389:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1789136063.617686:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff94a07021c000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1789136063.617934:0:21389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789136063.617960:0:21389:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789136063.617965:0:21389:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff94a07ad34ed8) has no exports 00000020:00000080:1.0:1789136063.618451:0:21389:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xedd53ca6b6e46895 00000020:00000080:1.0:1789136063.618458:0:21389:0:(genops.c:885:class_export_put()) final put ffff94a0660f3000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789136063.618538:0:21389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789136063.618545:0:21389:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1789136063.618548:0:21389:0:(genops.c:885:class_export_put()) final put ffff94a0660f0000/lustre-QMT0000_UUID 00000020:00000080:1.0:1789136063.618565:0:21389:0:(genops.c:844:class_export_destroy()) destroying export ffff94a0660f0000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1789136063.618574:0:21389:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:3.0:1789136063.619148:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff94a0660f3000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1789136063.619226:0:21389:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff94a076693f60 - data ffff94a058fb7798/ffff94a07587c400 00000020:01000000:1.0:1789136063.619373:0:21389:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff94a076a644e0 - data ffff949f4207e798/ffff94a076bd1400 00000001:00000004:1.0:1789136063.637760:0:21389:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000100:00080000:3.0:1789136063.703529:0:21389:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789136063.703540:0:21389:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789136063.703561:0:21389:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff94a07ad9bc00 x1876044587184768/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789136073 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136063.703599:0:21389:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1789136063.710565:0:21389:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789136063.710577:0:21389:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:3.0:1789136063.710615:0:21389:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789136063.710620:0:21389:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789136063.711266:0:17830:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789136063.711274:0:17830:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 2 count 1 00000040:00080000:0.0:1789136063.711285:0:17830:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:1.0:1789136063.715041:0:21389:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789136063.715049:0:21389:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:1.0:1789136063.715071:0:21389:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789136063.715074:0:21389:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1789136063.715434:0:17832:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1789136063.715443:0:17832:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 1 count 1 00000040:00080000:3.0:1789136063.715460:0:17832:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:0.0:1789136063.720932:0:21389:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xedd53ca6b6e46864 00000020:00000080:0.0:1789136063.720948:0:21389:0:(genops.c:885:class_export_put()) final put ffff94a076834800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789136063.721353:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff94a076834800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789136063.728192:0:21389:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xedd53ca6b6e46879 00000020:00000080:1.0:1789136063.728213:0:21389:0:(genops.c:885:class_export_put()) final put ffff94a076833000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789136063.728284:0:21389:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1789136063.728292:0:21389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789136063.728303:0:21389:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789136063.728308:0:21389:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff94a04907ced8) has no exports 00000004:01000000:1.0:1789136063.728513:0:21389:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1789136063.728524:0:21389:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xedd53ca6b6e468db 00000020:00000080:1.0:1789136063.728530:0:21389:0:(genops.c:885:class_export_put()) final put ffff94a081a80800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789136063.728535:0:21389:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1789136063.728539:0:21389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789136063.728544:0:21389:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789136063.728547:0:21389:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff94a075499a48) has no exports 00000020:00000080:1.0:1789136063.728555:0:21389:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xedd53ca6b6e468d4 00000020:00000080:1.0:1789136063.728559:0:21389:0:(genops.c:885:class_export_put()) final put ffff949f43ae5800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789136063.728991:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff94a076833000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00010000:01000000:1.0:1789136063.729441:0:21389:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1789136063.729449:0:21389:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789136063.729454:0:21389:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:1.0:1789136063.729462:0:21389:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789136063.729465:0:21389:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789136063.729502:0:21389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789136063.729511:0:21389:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789136063.729518:0:21389:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xedd53ca6b6e468c6 00000020:00000080:1.0:1789136063.729525:0:21389:0:(genops.c:885:class_export_put()) final put ffff94a076833800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789136063.729530:0:21389:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1789136063.729535:0:21389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789136063.729551:0:21389:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789136063.729555:0:21389:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff94a075498000) has no exports 00000020:00000080:1.0:1789136063.729560:0:21389:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xedd53ca6b6e468bf 00000020:00000080:1.0:1789136063.729564:0:21389:0:(genops.c:885:class_export_put()) final put ffff94a076836000/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1789136063.730157:0:21389:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1789136063.730162:0:21389:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789136063.730165:0:21389:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:1.0:1789136063.730169:0:21389:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789136063.730171:0:21389:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789136063.730536:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff94a081a80800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1789136063.730552:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff949f43ae5800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789136063.730560:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff949f43ae2000 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1789136063.730569:0:8:0:(genops.c:885:class_export_put()) final put ffff94a076832800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789136063.730572:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff94a076832800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1789136063.730578:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789136063.730682:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff94a076833800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1789136063.730689:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff94a076836000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789136063.730694:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94a076832000 for lustre-OST0000-osc-MDT0000 00000040:00080000:0.0:1789136063.730857:0:18569:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000080:1.0:1789136063.731246:0:21389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789136063.731261:0:21389:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789136063.731267:0:21389:0:(genops.c:885:class_export_put()) final put ffff94a076835000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789136063.731272:0:21389:0:(genops.c:844:class_export_destroy()) destroying export ffff94a076835000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1789136063.731284:0:21389:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1789136063.731399:0:21389:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1789136063.731408:0:21389:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xedd53ca6b6e468b1 00000020:00000080:1.0:1789136063.731415:0:21389:0:(genops.c:885:class_export_put()) final put ffff94a07c6f1800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789136063.731435:0:21389:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1789136063.731440:0:21389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789136063.731445:0:21389:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789136063.731449:0:21389:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff949f434e1a48) has no exports 00000020:00000080:1.0:1789136063.731456:0:21389:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xedd53ca6b6e468aa 00000020:00000080:1.0:1789136063.731459:0:21389:0:(genops.c:885:class_export_put()) final put ffff94a081abd800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789136063.731487:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff94a07c6f1800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1789136063.731504:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff94a081abd800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1789136063.735198:0:21389:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1789136063.735211:0:21389:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789136063.735217:0:21389:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789136063.735230:0:21389:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789136063.735314:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94a081ab9800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1789136063.735321:0:21389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789136063.735339:0:21389:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789136063.735349:0:21389:0:(genops.c:885:class_export_put()) final put ffff94a07021a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789136063.735355:0:21389:0:(genops.c:844:class_export_destroy()) destroying export ffff94a07021a800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1789136063.735380:0:21389:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789136063.735520:0:21389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789136063.735525:0:21389:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789136063.735528:0:21389:0:(genops.c:885:class_export_put()) final put ffff949f44887800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789136063.735531:0:21389:0:(genops.c:844:class_export_destroy()) destroying export ffff949f44887800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1789136063.735536:0:21389:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789136063.735588:0:21389:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xedd53ca6b6e46880 00000020:00000080:1.0:1789136063.735596:0:21389:0:(genops.c:885:class_export_put()) final put ffff94a076835800/lustre-MDD0000_UUID 00000020:01000000:1.0:1789136063.735613:0:21389:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1789136063.735617:0:21389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789136063.735622:0:21389:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789136063.735650:0:21389:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff94a049078000) has no exports 00000020:00000080:3.0:1789136063.735669:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff94a076835800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1789136063.735683:0:21389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789136063.735690:0:21389:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1789136063.735693:0:21389:0:(genops.c:885:class_export_put()) final put ffff94a076830000/lustre-MDD0000_UUID 00000020:00000080:1.0:1789136063.735696:0:21389:0:(genops.c:844:class_export_destroy()) destroying export ffff94a076830000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1789136063.735700:0:21389:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1789136063.735729:0:21389:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xedd53ca6b6e46887 00000020:00000080:1.0:1789136063.735735:0:21389:0:(genops.c:885:class_export_put()) final put ffff94a076834000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1789136063.735754:0:21389:0:(tgt_mount.c:187:server_put_mount()) put mount ffff949f44868000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1789136063.735757:0:21389:0:(obd_mount.c:710:lustre_put_lsi()) put ffff949f44868000 3 00000020:01000004:1.0:1789136063.735761:0:21389:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff949f44868000 from lustre-MDT0000 00000020:00000080:3.0:1789136063.735775:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff94a076834000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789136063.735794:0:21389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789136063.735801:0:21389:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1789136063.735804:0:21389:0:(genops.c:885:class_export_put()) final put ffff94a076830800/lustre-MDT0000_UUID 00000020:00000080:1.0:1789136063.735806:0:21389:0:(genops.c:844:class_export_destroy()) destroying export ffff94a076830800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1789136063.735816:0:21389:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1789136063.735861:0:21389:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1789136063.735866:0:21389:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1789136063.735869:0:21389:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1789136063.735967:0:21389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789136063.735980:0:21389:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789136063.735991:0:21389:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff949f4486e000 60cac2b7-c8b7-48ce-aa29-b6da8d73b5ee 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789136063.735999:0:21389:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff949f434e3490) has exports, disconnecting them 00000020:00080000:1.0:1789136063.736005:0:21389:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff949f4486e000), last request at 1789135974 00000020:00000080:1.0:1789136063.736029:0:21389:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xedd53ca6b6e4682c 00000020:00010000:1.0:1789136063.736041:0:21389:0:(genops.c:1921:obd_stale_export_put()) Put export ffff949f4486e000: total 0 00000100:00080000:1.0:1789136063.736050:0:21389:0:(import.c:65:import_set_state_nolock()) ffff949f4486e800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1789136063.736074:0:21389:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff949f4486e000): rc 0 00000020:00080000:1.0:1789136063.736082:0:21389:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff949f434e3490) has no exports 00000020:00010000:1.0:1789136063.736099:0:21390:0:(genops.c:1907:obd_stale_export_get()) Get export ffff949f4486e000: total 0 00010000:00010000:1.0:1789136063.736157:0:21390:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff949f4486e000, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1789136063.736200:0:21390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff949f4483dc00/0xedd53ca6b6e46dd5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xedd53ca6b6e46dce expref: 14 pid: 17799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136063.736239:0:21390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff949f4483cc00/0xedd53ca6b6e4694b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xedd53ca6b6e46944 expref: 13 pid: 17799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136063.736289:0:21390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff949f44249c00/0xedd53ca6b6e46ab7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xedd53ca6b6e46ab0 expref: 12 pid: 17799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136063.736323:0:21390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff949f43a19000/0xedd53ca6b6e46de3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xedd53ca6b6e46ddc expref: 11 pid: 17801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136063.736348:0:21390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94a043130800/0xedd53ca6b6e46a08 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xedd53ca6b6e46a01 expref: 10 pid: 17801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136063.736367:0:21390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff949f44249400/0xedd53ca6b6e46959 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xedd53ca6b6e46952 expref: 9 pid: 17800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136063.736388:0:21390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff949f4483da00/0xedd53ca6b6e4683a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xedd53ca6b6e46833 expref: 8 pid: 17800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136063.736428:0:21390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94a076a5d800/0xedd53ca6b6e46c54 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xedd53ca6b6e46c4d expref: 7 pid: 17800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136063.736464:0:21390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff949f43a19c00/0xedd53ca6b6e46df1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xedd53ca6b6e46dea expref: 6 pid: 17800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136063.736486:0:21390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff949f44248e00/0xedd53ca6b6e46967 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xedd53ca6b6e46960 expref: 5 pid: 17801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136063.736509:0:21390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff949f44248a00/0xedd53ca6b6e46c15 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xedd53ca6b6e46c0e expref: 4 pid: 17801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136063.736538:0:21390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff949f44248400/0xedd53ca6b6e46a8d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xedd53ca6b6e46a86 expref: 3 pid: 17799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136063.736559:0:21390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff949f44248c00/0xedd53ca6b6e46beb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xedd53ca6b6e46be4 expref: 2 pid: 17800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136063.736586:0:21390:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff949f4486e000, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1789136063.736623:0:21390:0:(genops.c:885:class_export_put()) final put ffff949f4486e000/60cac2b7-c8b7-48ce-aa29-b6da8d73b5ee 00010000:00010000:1.0:1789136063.736675:0:21390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136063.736680:0:21390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136063.736687:0:21390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789136063.736795:0:17800:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff94a050294600:17800] 1 exiting: rc = 0 00000100:00100000:2.0:1789136063.740059:0:17801:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff949f42645e00:17801] 2 exiting: rc = 0 00000100:00100000:2.0:1789136063.740178:0:17799:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff94a0805fe800:17799] 0 exiting: rc = 1 00000100:00100000:1.0:1789136063.741127:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136063.741139:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136063.741144:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136063.741151:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136063.741157:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136063.741163:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136063.741190:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136063.741197:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136063.741209:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136063.741223:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136063.741234:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136063.741243:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136063.741250:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136063.741257:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136063.741264:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136063.741269:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136063.741275:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136063.741281:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136063.741287:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136063.741293:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136063.741302:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136063.741309:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1789136063.741318:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff949f4486e000/60cac2b7-c8b7-48ce-aa29-b6da8d73b5ee for MGS 00000100:00100000:1.0:1789136063.741319:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136063.741336:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136063.741348:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136063.741356:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136063.741364:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136063.741370:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136063.741376:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136063.741382:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136063.741388:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136063.741394:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136063.741401:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136063.741407:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136063.741413:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136063.741419:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136063.741425:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136063.741431:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136063.741438:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136063.741444:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136063.741450:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136063.741465:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136063.741470:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136063.741476:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136063.741484:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136063.741495:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136063.741510:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1789136063.741511:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff949f4486e800 for MGS 00000100:00100000:1.0:1789136063.741523:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136063.741535:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136063.741541:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136063.741546:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136063.741552:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136063.741558:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136063.741565:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136063.741572:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136063.741578:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136063.741584:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136063.741591:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136063.741597:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136063.741603:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136063.741610:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136063.741616:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136063.741623:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136063.741665:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1789136063.750385:0:21389:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff949f4360d9c0 - data ffff94a051c26360/ffff949f42726000 00000020:01000000:1.0:1789136063.750514:0:21389:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff94a076a64960 - data ffff94a06fda66c0/ffff94a076bd1000 00000020:00000080:1.0:1789136063.751094:0:21389:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xedd53ca6b6e46810 00000020:00000080:1.0:1789136063.751104:0:21389:0:(genops.c:885:class_export_put()) final put ffff949f437b8800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1789136063.751122:0:21389:0:(tgt_mount.c:187:server_put_mount()) put mount ffff949f44868000 from MGS, refs=2 00000020:01000004:1.0:1789136063.751126:0:21389:0:(obd_mount.c:710:lustre_put_lsi()) put ffff949f44868000 2 00000020:01000004:1.0:1789136063.751129:0:21389:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff949f44868000 from MGS 00000020:00000080:1.0:1789136063.751148:0:21389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789136063.751155:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff949f437b8800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789136063.751156:0:21389:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1789136063.751161:0:21389:0:(genops.c:885:class_export_put()) final put ffff949f437ba000/MGS 00000020:00000080:1.0:1789136063.751167:0:21389:0:(genops.c:844:class_export_destroy()) destroying export ffff949f437ba000/MGS for MGS 00000020:01000000:1.0:1789136063.751181:0:21389:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1789136063.751248:0:21389:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1789136063.751252:0:21389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789136063.751258:0:21389:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789136063.751264:0:21389:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff94a044e6f800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789136063.751270:0:21389:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff94a07ad30000) has exports, disconnecting them 00000020:00080000:1.0:1789136063.751274:0:21389:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff94a044e6f800), last request at 1789135974 00000020:00000080:1.0:1789136063.751278:0:21389:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xedd53ca6b6e46913 00000020:00080000:1.0:1789136063.751290:0:21389:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff94a044e6f800): rc 0 00000020:00000080:1.0:1789136063.751295:0:21389:0:(genops.c:885:class_export_put()) final put ffff94a044e6f800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1789136063.751338:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff94a044e6f800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1789136063.754736:0:21389:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1789136063.754749:0:21389:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789136063.754755:0:21389:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789136063.754764:0:21389:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789136063.754806:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94a044e68000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1789136063.755416:0:21389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789136063.755428:0:21389:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1789136063.755435:0:21389:0:(genops.c:885:class_export_put()) final put ffff94a044e6f000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1789136063.755439:0:21389:0:(genops.c:844:class_export_destroy()) destroying export ffff94a044e6f000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1789136063.755449:0:21389:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1789136063.755554:0:21389:0:(obd_mount.c:710:lustre_put_lsi()) put ffff949f44868000 1 00000020:00000080:3.0:1789136063.755561:0:21389:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xedd53ca6b6e46802 00000020:00000080:3.0:1789136063.755569:0:21389:0:(genops.c:885:class_export_put()) final put ffff949f437b8000/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1789136063.755582:0:21389:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1789136063.755592:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff949f437b8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789136063.755603:0:21389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789136063.755608:0:21389:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789136063.755612:0:21389:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff94a07ad33490) has no exports 00000020:00000080:3.0:1789136063.926152:0:21389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789136063.926165:0:21389:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1789136063.926171:0:21389:0:(genops.c:885:class_export_put()) final put ffff949f443e4000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789136063.926176:0:21389:0:(genops.c:844:class_export_destroy()) destroying export ffff949f443e4000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1789136063.926187:0:21389:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1789136063.926315:0:21389:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff949f443e7000 00000020:02000400:3.0:1789136063.926378:0:21389:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1789136064.240950:0:17796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136065.265945:0:17795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136066.288797:0:21390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789136066.545244:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789136066.545266:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a0556dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876044587185152:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789136066.545332:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136066.545379:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789136066.545388:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07ad9a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876044587185280:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789136066.545418:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136066.545452:0:17811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587185280 00000100:00100000:2.0:1789136066.545459:0:17811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587185280 00000100:00100000:2.0:1789136066.545508:0:17811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789136066.545515:0:17811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a06f1a61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3648:x1876044587185280:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:2.0:1789136066.545522:0:17811:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1789136066.545561:0:17811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a06f1a61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3648:x1876044587185280:12345-0@lo:41:osp-pre-0-1.0 Request processed in 44us (141us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789136066.545567:0:17811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:02020000:2.0:1789136066.545601:0:3648:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00100000:0.0:1789136066.548190:0:19321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587185152 00000100:00100000:0.0:1789136066.548202:0:19321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587185152 00000100:00100000:0.0:1789136066.548271:0:19321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789136066.548280:0:19321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a06f1a43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876044587185152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789136066.548309:0:19321:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915845632 avail 3684323328 00000100:00100000:0.0:1789136066.548375:0:19321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a06f1a43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876044587185152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (3042us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136066.548382:0:19321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1789136066.548482:0:17802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789136066.552744:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a0556dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876044587185152:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789136066.556256:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789136066.556264:0:3648:0:(import.c:65:import_set_state_nolock()) ffff949f439e0000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1789136066.556268:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1789136066.571497:0:3648:0:(import.c:65:import_set_state_nolock()) ffff949f439e0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789136066.571509:0:3648:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 527 00000100:00080000:2.0:1789136066.571518:0:3648:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff949f439e0000 using connection 192.168.206.156@tcp/0@lo 00000100:00100000:2.0:1789136066.571576:0:3648:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94a06f1a6580 x1876044587185408/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789136066.571683:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a06f1a6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876044587185408:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1789136066.571747:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136066.572958:0:20772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587185408 00000100:00100000:2.0:1789136066.572980:0:20772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587185408 00000100:00100000:2.0:1789136066.573019:0:20772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789136066.573026:0:20772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a07ad98780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3644:x1876044587185408:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:2.0:1789136066.573048:0:20772:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789136066.593134:0:20772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a07ad98780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3644:x1876044587185408:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 20098us (21377us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789136066.593148:0:20772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:0.0:1789136066.593235:0:3644:0:(import.c:65:import_set_state_nolock()) ffff949f439e0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789136066.593241:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789136066.593245:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a06f1a6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876044587185408:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:0.0:1789136067.056885:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789136067.056892:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789136067.056896:0:37:0:(import.c:65:import_set_state_nolock()) ffff949f439e0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789136067.056904:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 604 00000100:00080000:0.0:1789136067.056910:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789136067.056918:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff949f439e0000 using connection 192.168.206.156@tcp/0@lo 00000100:00100000:0.0:1789136067.056941:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94a07ad98b40 x1876044587185664/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789136067.057039:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07ad9bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876044587185792:0@lo:400:kworker.0 00000100:00100000:0.0:1789136067.057110:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136067.057140:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07ad992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876044587186304:0@lo:400:kworker.0 00000100:00100000:0.0:1789136067.057165:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136067.057186:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789136067.057191:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07ad99e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876044587185920:0@lo:400:kworker.0 00000100:00100000:0.0:1789136067.057212:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136067.057228:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07ad98f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876044587186432:0@lo:400:kworker.0 00000100:00100000:0.0:1789136067.057247:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136067.057276:0:19319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587185792 00000100:00100000:0.0:1789136067.057282:0:19319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587185792 00000100:00100000:0.0:1789136067.057336:0:19319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587185920 00000100:00100000:0.0:1789136067.057339:0:19319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587185920 00000100:00100000:0.0:1789136067.057366:0:19319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789136067.057375:0:19319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f429f92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876044587185792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136067.057434:0:19319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f429f92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876044587185792:12345-0@lo:400:kworker.0 Request processed in 60us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136067.057442:0:19319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789136067.057457:0:19319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789136067.057463:0:19319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a055723480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876044587185920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136067.057490:0:19319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a055723480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876044587185920:12345-0@lo:400:kworker.0 Request processed in 27us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136067.057496:0:19319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789136067.057533:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07ad99e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876044587185920:0@lo:400:kworker.0 00000100:00100000:0.0:1789136067.057544:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07ad9bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876044587185792:0@lo:400:kworker.0 00000100:00100000:3.0:1789136067.057614:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07ad9b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876044587186048:0@lo:400:kworker.0 00000100:00100000:3.0:1789136067.057680:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136067.057703:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f429f9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876044587186560:0@lo:400:kworker.0 00000100:00100000:3.0:1789136067.057725:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136067.057745:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789136067.057751:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07ad98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:60cac2b7-c8b7-48ce-aa29-b6da8d73b5ee:3647:1876044587185536:0@lo:400:kworker.0 00000400:00000100:3.0:1789136067.057769:0:3647:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876044587185536 offset 0 length 224: 4 00000100:00100000:3.0:1789136067.057788:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07ad983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876044587186176:0@lo:400:kworker.0 00000100:00100000:3.0:1789136067.057821:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136067.057845:0:20771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587186304 00000100:00100000:3.0:1789136067.057849:0:20771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587186304 00000100:00100000:3.0:1789136067.057871:0:20771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587186432 00000100:00100000:3.0:1789136067.057874:0:20771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587186432 00000100:00100000:3.0:1789136067.057883:0:20771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587186048 00000100:00100000:3.0:1789136067.057885:0:20771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587186048 00000100:00100000:3.0:1789136067.057891:0:20771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587186560 00000100:00100000:3.0:1789136067.057893:0:20771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587186560 00000100:00100000:3.0:1789136067.057905:0:20771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587186176 00000100:00100000:3.0:1789136067.057907:0:20771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587186176 00000100:00100000:3.0:1789136067.057916:0:20771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789136067.057922:0:20771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a055721e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876044587186304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136067.057973:0:20771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a055721e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876044587186304:12345-0@lo:400:kworker.0 Request processed in 51us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136067.057980:0:20771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789136067.058000:0:20771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789136067.058006:0:20771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0556dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876044587186560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136067.058040:0:20771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0556dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876044587186560:12345-0@lo:400:kworker.0 Request processed in 34us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136067.058046:0:20771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789136067.058058:0:20771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789136067.058062:0:20771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a055720b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1876044587186432:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1789136067.058067:0:20771:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789136067.058091:0:20771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a055720b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1876044587186432:12345-0@lo:400:kworker.0 Request processed in 27us (843us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789136067.058096:0:20771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789136067.058107:0:20771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789136067.058111:0:20771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0556de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1876044587186048:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1789136067.058114:0:20771:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789136067.058134:0:20771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0556de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1876044587186048:12345-0@lo:400:kworker.0 Request processed in 22us (454us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789136067.058140:0:20771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789136067.058151:0:20771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789136067.058155:0:20771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0556dd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1876044587186176:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1789136067.058159:0:20771:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789136067.058180:0:20771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0556dd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1876044587186176:12345-0@lo:400:kworker.0 Request processed in 23us (359us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789136067.058185:0:20771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1789136067.058204:0:17802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789136067.058208:0:17802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789136067.058230:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789136067.058234:0:3647:0:(import.c:65:import_set_state_nolock()) ffff94a07021f000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1789136067.058243:0:3647:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1789136067.058248:0:3647:0:(import.c:65:import_set_state_nolock()) ffff94a07021f000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789136067.058251:0:3647:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 543 00000100:00080000:3.0:1789136067.058256:0:3647:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff94a07021f000 using connection 192.168.206.156@tcp/0@lo 00000100:00100000:3.0:1789136067.058277:0:3647:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94a0556dc3c0 x1876044587186688/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789136067.058291:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07ad983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876044587186176:0@lo:400:kworker.0 00000100:00080000:3.0:1789136067.058301:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789136067.058304:0:3647:0:(import.c:65:import_set_state_nolock()) ffff94a052ad5800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1789136067.058307:0:3647:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1789136067.058309:0:3647:0:(import.c:65:import_set_state_nolock()) ffff94a052ad5800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789136067.058312:0:3647:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 527 00000100:00080000:3.0:1789136067.058316:0:3647:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff94a052ad5800 using connection 192.168.206.156@tcp/0@lo 00000100:00100000:3.0:1789136067.058326:0:3647:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94a0556ded00 x1876044587186816/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789136067.058335:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07ad9b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876044587186048:0@lo:400:kworker.0 00010000:00080000:3.0:1789136067.058347:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff949f429f9a40 x1876044587186560/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136067.058356:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f429f9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876044587186560:0@lo:400:kworker.0 00000100:00080000:3.0:1789136067.058385:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789136067.058388:0:3645:0:(import.c:65:import_set_state_nolock()) ffff949f449c9800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1789136067.058391:0:3645:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1789136067.058399:0:3645:0:(import.c:65:import_set_state_nolock()) ffff949f449c9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789136067.058403:0:3645:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 559 00000100:00080000:3.0:1789136067.058407:0:3645:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff949f449c9800 using connection 192.168.206.156@tcp/0@lo 00000100:00100000:3.0:1789136067.058421:0:3645:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff949f429f9a40 x1876044587186944/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789136067.058431:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07ad98f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876044587186432:0@lo:400:kworker.0 00010000:00080000:3.0:1789136067.058443:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff94a07ad992c0 x1876044587186304/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136067.058451:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07ad992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876044587186304:0@lo:400:kworker.0 00000100:00100000:1.0:1789136067.058921:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07ad98b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876044587185664:0@lo:38:kworker.0 00000100:00100000:1.0:1789136067.058959:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136067.058989:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a0556dc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1876044587186688:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1789136067.059009:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136067.059021:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a0556ded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876044587186816:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1789136067.059036:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136067.059046:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f429f9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1876044587186944:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1789136067.059073:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136067.059356:0:17808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587186688 00000100:00100000:0.0:1789136067.059362:0:17808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587186688 00000100:00100000:0.0:1789136067.059581:0:17808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587186816 00000100:00100000:0.0:1789136067.059585:0:17808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587186816 00000100:00100000:0.0:1789136067.059597:0:17808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587186944 00000100:00100000:0.0:1789136067.059599:0:17808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587186944 00000100:00100000:0.0:1789136067.059609:0:17808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789136067.059615:0:17808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a081848b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1876044587186688:12345-0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1789136067.059758:0:17812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587185664 00000100:00100000:3.0:1789136067.059763:0:17812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587185664 00000100:00100000:3.0:1789136067.059783:0:17812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789136067.059800:0:17812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0818492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1876044587185664:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1789136067.059821:0:17812:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789136067.059870:0:17812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0818492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1876044587185664:12345-0@lo:38:kworker.0 Request processed in 80us (910us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789136067.059876:0:17812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789136067.059897:0:17807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789136067.059902:0:17807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a08184b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1876044587186816:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:3.0:1789136067.059912:0:17807:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789136067.059936:0:17807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a08184b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1876044587186816:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 34us (899us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789136067.059943:0:17807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789136067.059956:0:17807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789136067.059969:0:17807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a081848780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1876044587186944:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:3.0:1789136067.059979:0:17807:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789136067.060003:0:17807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a081848780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1876044587186944:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 33us (929us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789136067.060008:0:17807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:3.0:1789136067.060039:0:3644:0:(import.c:65:import_set_state_nolock()) ffff949f439e0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789136067.060044:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789136067.060048:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07ad98b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876044587185664:0@lo:38:kworker.0 00000100:00080000:3.0:1789136067.060057:0:3644:0:(import.c:65:import_set_state_nolock()) ffff94a052ad5800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00010000:00020000:0.0:1789136067.060231:0:17808:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789136067.060263:0:17808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a081848b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1876044587186688:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 647us (1252us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789136067.060269:0:17808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789136067.060484:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4416fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876044587187072:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789136067.060521:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789136067.061013:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789136067.061018:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a0556ded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876044587186816:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:3.0:1789136067.061037:0:3644:0:(import.c:65:import_set_state_nolock()) ffff949f449c9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789136067.061040:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789136067.061043:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f429f9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1876044587186944:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1789136067.061174:0:19321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587187072 00000100:00100000:0.0:1789136067.061190:0:19321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587187072 00000100:00100000:0.0:1789136067.061228:0:19321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789136067.061236:0:19321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a06f1a7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876044587187072:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789136067.061262:0:19321:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1789136067.061312:0:19321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a06f1a7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876044587187072:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (790us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136067.061319:0:19321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789136067.061355:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4416fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876044587187072:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1789136067.061581:0:3644:0:(import.c:65:import_set_state_nolock()) ffff94a07021f000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789136067.061585:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789136067.061589:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a0556dc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1876044587186688:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:2.0:1789136067.313041:0:17796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789136067.546957:0:21590:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1789136067.557025:0:21590:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:1.0:1789136067.557082:0:21590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a043130600/0xedd53ca6b6e46a01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e46a08 expref: -99 pid: 18541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136067.557096:0:21590:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a043130600/0xedd53ca6b6e46a01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xedd53ca6b6e46a08 expref: -99 pid: 18541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136067.557103:0:21590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a043130600/0xedd53ca6b6e46a01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xedd53ca6b6e46a08 expref: -99 pid: 18541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136067.557125:0:21590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.156@tcp lock: ffff94a043130600/0xedd53ca6b6e46a01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xedd53ca6b6e46a08 expref: -99 pid: 18541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136067.557148:0:21590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789136067.557154:0:21590:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789136067.557181:0:21590:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789136067.557186:0:21590:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789136067.557192:0:21590:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789136067.557198:0:21590:0:(import.c:65:import_set_state_nolock()) ffff94a052ad5800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1789136067.557274:0:21590:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789136067.557277:0:21590:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789136067.557281:0:21590:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789136067.558368:0:17795:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789136067.558379:0:17795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.156@tcp lock: ffff94a043130600/0xedd53ca6b6e46a01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xedd53ca6b6e46a08 expref: -99 pid: 18541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136067.558389:0:17795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a043130600 already unused, calling callback (ffffffffc13c2c20) 10000000:00010000:3.0:1789136067.558393:0:17795:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.156@tcp lock: ffff94a043130600/0xedd53ca6b6e46a01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xedd53ca6b6e46a08 expref: -99 pid: 18541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136067.558416:0:17795:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.156@tcp lock: ffff94a043130600/0xedd53ca6b6e46a01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xedd53ca6b6e46a08 expref: -99 pid: 18541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789136067.558423:0:17795:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.156@tcp lock: ffff94a043130600/0xedd53ca6b6e46a01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xedd53ca6b6e46a08 expref: -99 pid: 18541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789136067.558428:0:17795:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789136067.558430:0:17795:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789136067.558433:0:17795:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789136067.558464:0:17795:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.156@tcp lock: ffff94a043130600/0xedd53ca6b6e46a01 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xedd53ca6b6e46a08 expref: -99 pid: 18541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136067.558471:0:17795:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789136067.558491:0:17795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.156@tcp lock: ffff94a043130600/0xedd53ca6b6e46a01 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xedd53ca6b6e46a08 expref: -99 pid: 18541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136067.558499:0:17795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.156@tcp lock: ffff94a043130600/0xedd53ca6b6e46a01 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xedd53ca6b6e46a08 expref: -99 pid: 18541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136067.558511:0:17795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136067.558513:0:17795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136067.558515:0:17795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789136067.558657:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f429f9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:60cac2b7-c8b7-48ce-aa29-b6da8d73b5ee:3645:1876044587187200:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789136067.558721:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136067.558837:0:17792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587187200 00000100:00100000:3.0:1789136067.558844:0:17792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587187200 00000100:00100000:3.0:1789136067.558888:0:17792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789136067.558895:0:17792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a07ad98b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3645:x1876044587187200:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1789136067.558901:0:17792:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789136067 with bad export cookie 17137670643758950444 00010000:00010000:1.0:1789136067.559408:0:21590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a043130a00/0xedd53ca6b6e46960 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e46967 expref: -99 pid: 18541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136067.559419:0:21590:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a043130a00/0xedd53ca6b6e46960 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xedd53ca6b6e46967 expref: -99 pid: 18541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136067.559426:0:21590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a043130a00/0xedd53ca6b6e46960 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xedd53ca6b6e46967 expref: -99 pid: 18541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136067.559433:0:21590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.156@tcp lock: ffff94a043130a00/0xedd53ca6b6e46960 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xedd53ca6b6e46967 expref: -99 pid: 18541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136067.559491:0:21590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789136067.559498:0:21590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a07a32de00/0xedd53ca6b6e46c4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e46c54 expref: -99 pid: 17803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136067.559518:0:21590:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a07a32de00/0xedd53ca6b6e46c4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xedd53ca6b6e46c54 expref: -99 pid: 17803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136067.559524:0:21590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a07a32de00/0xedd53ca6b6e46c4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xedd53ca6b6e46c54 expref: -99 pid: 17803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136067.559530:0:21590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.156@tcp lock: ffff94a07a32de00/0xedd53ca6b6e46c4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xedd53ca6b6e46c54 expref: -99 pid: 17803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136067.569304:0:21390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789136067.569319:0:21390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.156@tcp lock: ffff94a043130a00/0xedd53ca6b6e46960 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xedd53ca6b6e46967 expref: -99 pid: 18541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136067.569332:0:21390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a043130a00 already unused, calling callback (ffffffffc13c2c20) 10000000:00010000:0.0:1789136067.569336:0:21390:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.156@tcp lock: ffff94a043130a00/0xedd53ca6b6e46960 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xedd53ca6b6e46967 expref: -99 pid: 18541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136067.569347:0:21390:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.156@tcp lock: ffff94a043130a00/0xedd53ca6b6e46960 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xedd53ca6b6e46967 expref: -99 pid: 18541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789136067.569355:0:21390:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.156@tcp lock: ffff94a043130a00/0xedd53ca6b6e46960 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xedd53ca6b6e46967 expref: -99 pid: 18541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789136067.569361:0:21390:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789136067.569363:0:21390:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:0.0:1789136067.569401:0:21390:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.156@tcp lock: ffff94a043130a00/0xedd53ca6b6e46960 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xedd53ca6b6e46967 expref: -99 pid: 18541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136067.569423:0:21390:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789136067.569451:0:21390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.156@tcp lock: ffff94a043130a00/0xedd53ca6b6e46960 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xedd53ca6b6e46967 expref: -99 pid: 18541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136067.569458:0:21390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.156@tcp lock: ffff94a043130a00/0xedd53ca6b6e46960 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xedd53ca6b6e46967 expref: -99 pid: 18541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136067.569475:0:21390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789136067.569479:0:21390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.156@tcp lock: ffff94a07a32de00/0xedd53ca6b6e46c4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xedd53ca6b6e46c54 expref: -99 pid: 17803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136067.569484:0:21390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a07a32de00 already unused, calling callback (ffffffffc13c2c20) 10000000:00010000:0.0:1789136067.569487:0:21390:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.156@tcp lock: ffff94a07a32de00/0xedd53ca6b6e46c4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xedd53ca6b6e46c54 expref: -99 pid: 17803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136067.569493:0:21390:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.156@tcp lock: ffff94a07a32de00/0xedd53ca6b6e46c4d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xedd53ca6b6e46c54 expref: -99 pid: 17803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789136067.569499:0:21390:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.156@tcp lock: ffff94a07a32de00/0xedd53ca6b6e46c4d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xedd53ca6b6e46c54 expref: -99 pid: 17803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789136067.569504:0:21390:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1789136067.569506:0:21390:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:0.0:1789136067.569517:0:21390:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.156@tcp lock: ffff94a07a32de00/0xedd53ca6b6e46c4d lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xedd53ca6b6e46c54 expref: -99 pid: 17803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136067.569522:0:21390:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789136067.569534:0:21390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.156@tcp lock: ffff94a07a32de00/0xedd53ca6b6e46c4d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xedd53ca6b6e46c54 expref: -99 pid: 17803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136067.569552:0:21390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136067.569554:0:21390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136067.569556:0:21390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789136067.569580:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07ad98f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:60cac2b7-c8b7-48ce-aa29-b6da8d73b5ee:3647:1876044587187456:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789136067.569779:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136067.569948:0:20957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587187456 00000100:00100000:0.0:1789136067.569955:0:20957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587187456 00000100:00100000:0.0:1789136067.569991:0:20957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789136067.569998:0:20957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a07ad9b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3647:x1876044587187456:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789136067.570004:0:20957:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789136067 with bad export cookie 17137670643758950444 00000100:00100000:0.0:1789136067.570043:0:20957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a07ad9b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3647:x1876044587187456:12345-0@lo:103:ldlm_bl.0 Request processed in 44us (265us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789136067.570050:0:20957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1789136067.570082:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.156@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789136067.570086:0:3647:0:(import.c:65:import_set_state_nolock()) ffff949f4486c800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1789136067.570089:0:3647:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.206.156@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:1.0:1789136067.574382:0:21590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789136067.574395:0:21590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.156@tcp lock: ffff94a07a32de00/0xedd53ca6b6e46c4d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xedd53ca6b6e46c54 expref: -99 pid: 17803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789136067.574419:0:21590:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1789136067.574435:0:21590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a076a5cc00/0xedd53ca6b6e46dea lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e46df1 expref: -99 pid: 17803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136067.574443:0:21590:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a076a5cc00/0xedd53ca6b6e46dea lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xedd53ca6b6e46df1 expref: -99 pid: 17803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136067.574451:0:21590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a076a5cc00/0xedd53ca6b6e46dea lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xedd53ca6b6e46df1 expref: -99 pid: 17803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136067.574458:0:21590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.156@tcp lock: ffff94a076a5cc00/0xedd53ca6b6e46dea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xedd53ca6b6e46df1 expref: -99 pid: 17803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136067.574486:0:21590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789136067.574493:0:21590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a043131c00/0xedd53ca6b6e46952 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e46959 expref: -99 pid: 18541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136067.574519:0:21590:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a043131c00/0xedd53ca6b6e46952 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xedd53ca6b6e46959 expref: -99 pid: 18541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136067.574525:0:21590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a043131c00/0xedd53ca6b6e46952 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xedd53ca6b6e46959 expref: -99 pid: 18541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136067.574530:0:21590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.156@tcp lock: ffff94a043131c00/0xedd53ca6b6e46952 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xedd53ca6b6e46959 expref: -99 pid: 18541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136067.574546:0:21590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1789136067.574550:0:21590:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:1.0:1789136067.574553:0:21590:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:1.0:1789136067.574596:0:21590:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:1.0:1789136067.574601:0:21590:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:1.0:1789136067.574606:0:21590:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789136067.574611:0:21590:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1789136067.574619:0:21590:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff949f4286b800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789136067.574643:0:21590:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff94a044e39000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789136067.574648:0:21590:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff94a07549ced8) has exports, disconnecting them 00000020:00080000:1.0:1789136067.574653:0:21590:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff949f4286b800), last request at 1789136067 00000020:00000080:1.0:1789136067.574659:0:21590:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xedd53ca6b6e46c3f 00000100:00080000:1.0:1789136067.574675:0:21590:0:(import.c:65:import_set_state_nolock()) ffff949f4286e000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1789136067.574721:0:21590:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff949f4286b800): rc 0 00000020:00000080:1.0:1789136067.574724:0:21590:0:(genops.c:885:class_export_put()) final put ffff949f4286b800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:1.0:1789136067.574740:0:21590:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff94a044e39000), last request at 1789136067 00000020:00000080:1.0:1789136067.574744:0:21590:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xedd53ca6b6e46ae1 00000100:00080000:1.0:1789136067.574749:0:21590:0:(import.c:65:import_set_state_nolock()) ffff94a08185c800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1789136067.574762:0:21590:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff94a044e39000): rc 0 00000020:00000080:1.0:1789136067.574764:0:21590:0:(genops.c:885:class_export_put()) final put ffff94a044e39000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:1.0:1789136067.574770:0:21590:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb368c192fae0 00000100:00080000:1.0:1789136067.574787:0:21590:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:2.0:1789136067.574892:0:17796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789136067.574900:0:17796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.156@tcp lock: ffff94a076a5cc00/0xedd53ca6b6e46dea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xedd53ca6b6e46df1 expref: -99 pid: 17803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136067.574907:0:17796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a076a5cc00 already unused, calling callback (ffffffffc13c2c20) 10000000:00010000:2.0:1789136067.574911:0:17796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.156@tcp lock: ffff94a076a5cc00/0xedd53ca6b6e46dea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xedd53ca6b6e46df1 expref: -99 pid: 17803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136067.574918:0:17796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.156@tcp lock: ffff94a076a5cc00/0xedd53ca6b6e46dea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xedd53ca6b6e46df1 expref: -99 pid: 17803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789136067.574925:0:17796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.156@tcp lock: ffff94a076a5cc00/0xedd53ca6b6e46dea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xedd53ca6b6e46df1 expref: -99 pid: 17803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789136067.574930:0:17796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789136067.574932:0:17796:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1789136067.574934:0:17796:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1789136067.576145:0:17795:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789136067.576152:0:17795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.156@tcp lock: ffff94a043131c00/0xedd53ca6b6e46952 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xedd53ca6b6e46959 expref: -99 pid: 18541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136067.576172:0:17795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a043131c00 already unused, calling callback (ffffffffc13c2c20) 10000000:00010000:3.0:1789136067.576175:0:17795:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.156@tcp lock: ffff94a043131c00/0xedd53ca6b6e46952 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xedd53ca6b6e46959 expref: -99 pid: 18541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136067.576183:0:17795:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.156@tcp lock: ffff94a043131c00/0xedd53ca6b6e46952 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xedd53ca6b6e46959 expref: -99 pid: 18541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789136067.576190:0:17795:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.156@tcp lock: ffff94a043131c00/0xedd53ca6b6e46952 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xedd53ca6b6e46959 expref: -99 pid: 18541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789136067.576195:0:17795:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1789136067.576197:0:17795:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1789136067.576200:0:17795:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00100000:1.0:1789136067.576339:0:21590:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff94a07ad9a1c0 x1876044587185280/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789136082 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136067.576356:0:21590:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789136067.577497:0:21590:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789136067.577505:0:21590:0:(import.c:65:import_set_state_nolock()) ffff949f439e0000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1789136067.587771:0:3647:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.206.156@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1789136067.587775:0:3647:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1789136067.587784:0:3647:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff94a07ad98000 x1876044587185536/t0(0) o400->MGC192.168.206.156@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789136083 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136067.587797:0:3647:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff949f429f9a40 x1876044587187200/t0(0) o103->MGC192.168.206.156@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789136083 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136067.587817:0:3647:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff94a07ad98f00 x1876044587187456/t0(0) o103->MGC192.168.206.156@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789136083 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1789136067.587825:0:3647:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1789136067.587841:0:3647:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1789136067.587842:0:3647:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00010000:00010000:2.0:1789136067.588002:0:17796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.156@tcp lock: ffff94a076a5cc00/0xedd53ca6b6e46dea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xedd53ca6b6e46df1 expref: -99 pid: 17803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136067.588022:0:17796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789136067.588038:0:17796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.156@tcp lock: ffff94a076a5cc00/0xedd53ca6b6e46dea lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xedd53ca6b6e46df1 expref: -99 pid: 17803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136067.588045:0:17796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.156@tcp lock: ffff94a076a5cc00/0xedd53ca6b6e46dea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xedd53ca6b6e46df1 expref: -99 pid: 17803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136067.588062:0:17796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136067.588065:0:17796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136067.588067:0:17796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136067.588458:0:17795:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.156@tcp lock: ffff94a043131c00/0xedd53ca6b6e46952 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xedd53ca6b6e46959 expref: -99 pid: 18541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136067.588466:0:17795:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789136067.588475:0:17795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.156@tcp lock: ffff94a043131c00/0xedd53ca6b6e46952 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xedd53ca6b6e46959 expref: -99 pid: 18541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136067.588482:0:17795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.156@tcp lock: ffff94a043131c00/0xedd53ca6b6e46952 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xedd53ca6b6e46959 expref: -99 pid: 18541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136067.588497:0:17795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136067.588499:0:17795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136067.588501:0:17795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789136067.588754:0:17792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a07ad98b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3645:x1876044587187200:12345-0@lo:103:ldlm_bl.0 Request processed in 29857us (30031us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789136067.588764:0:17792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1789136067.589651:0:3647:0:(import.c:65:import_set_state_nolock()) ffff949f4486c800 MGS: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1789136067.589653:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07ad992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:60cac2b7-c8b7-48ce-aa29-b6da8d73b5ee:0:1876044587187328:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1789136067.589657:0:3647:0:(import.c:510:import_select_connection()) MGC192.168.206.156@tcp: connect to NID 0@lo last attempt 512 00000100:00080000:0.0:1789136067.589725:0:3647:0:(import.c:624:import_select_connection()) MGC192.168.206.156@tcp: import ffff949f4486c800 using connection 192.168.206.156@tcp/0@lo 00000020:00000080:0.0:1789136067.589740:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff949f4286b800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:0.0:1789136067.589975:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff94a044e39000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:0.0:1789136067.590068:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff949f4286e000 for lustre-MDT0001 00000020:00000080:0.0:1789136067.590074:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94a08185c800 for lustre-MDT0001 00000100:00100000:0.0:1789136067.590091:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a06f1a7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:60cac2b7-c8b7-48ce-aa29-b6da8d73b5ee:0:1876044587187584:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789136067.590099:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07ad9a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876044587185280:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789136067.590199:0:21390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789136067.590303:0:3647:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94a07ad9a1c0 x1876044587187840/t0(0) o250->MGC192.168.206.156@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789136067.590353:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07ad9a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60cac2b7-c8b7-48ce-aa29-b6da8d73b5ee:3644:1876044587187840:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:3.0:1789136067.590402:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876044587187840 offset 0 length 520: 4 00000100:00100000:0.0:1789136067.590467:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07ad98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:60cac2b7-c8b7-48ce-aa29-b6da8d73b5ee:3647:1876044587185536:0@lo:400:kworker.0 00000100:00100000:0.0:1789136067.590481:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07ad98f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:60cac2b7-c8b7-48ce-aa29-b6da8d73b5ee:3647:1876044587187456:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789136067.591042:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a0556dc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:60cac2b7-c8b7-48ce-aa29-b6da8d73b5ee:0:1876044587187712:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789136067.591056:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f429f9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:60cac2b7-c8b7-48ce-aa29-b6da8d73b5ee:3645:1876044587187200:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1789136067.591198:0:21590:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789136067.591202:0:21590:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:1.0:1789136067.591216:0:21590:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1789136067.591277:0:21590:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1789136067.591293:0:21590:0:(import.c:65:import_set_state_nolock()) ffff94a060ee3800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1789136067.591314:0:21590:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789136067.591317:0:21590:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:1.0:1789136067.591332:0:21590:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1789136067.591401:0:21590:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1789136067.591410:0:21590:0:(import.c:65:import_set_state_nolock()) ffff94a06613b800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1789136067.591450:0:21590:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff94a07549ced8) has no exports 00000100:00100000:3.0:1789136067.591725:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4416f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876044587187968:0@lo:9:umount.0 00000100:00100000:3.0:1789136067.591783:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136067.591826:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4416de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876044587188096:0@lo:9:umount.0 00000100:00100000:3.0:1789136067.591847:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136067.591906:0:19318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587187968 00000100:00100000:0.0:1789136067.591912:0:19318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587187968 00000100:00100000:0.0:1789136067.591958:0:19318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587188096 00000100:00100000:0.0:1789136067.591961:0:19318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587188096 00000100:00100000:0.0:1789136067.591995:0:19318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789136067.592003:0:19318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0556ded00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876044587187968:12345-0@lo:9:umount.0 00000020:00000080:0.0:1789136067.592026:0:19318:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xedd53ca6b6e46b0b 00000100:00080000:0.0:1789136067.592035:0:19318:0:(import.c:65:import_set_state_nolock()) ffff94a046a3d000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789136067.592081:0:19318:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:2.0:1789136067.592103:0:19317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789136067.592112:0:19317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0556dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876044587188096:12345-0@lo:9:umount.0 00000020:00000080:2.0:1789136067.592124:0:19317:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xedd53ca6b6e46c70 00000100:00080000:2.0:1789136067.592129:0:19317:0:(import.c:65:import_set_state_nolock()) ffff949f43795800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789136067.592161:0:19317:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1789136067.592203:0:19318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0556ded00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3644:x1876044587187968:12345-0@lo:9:umount.0 Request processed in 201us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136067.592217:0:19318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789136067.592312:0:19317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0556dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3644:x1876044587188096:12345-0@lo:9:umount.0 Request processed in 202us (463us total) trans 0 rc 0/0 00000100:00080000:0.0:1789136067.592317:0:3644:0:(import.c:65:import_set_state_nolock()) ffff94a060ee3800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1789136067.592319:0:19317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000004:00080000:0.0:1789136067.592326:0:3644:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1789136067.592328:0:3644:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789136067.592331:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4416f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876044587187968:0@lo:9:umount.0 00000100:00080000:0.0:1789136067.592341:0:3644:0:(import.c:65:import_set_state_nolock()) ffff94a06613b800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1789136067.592356:0:3644:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1789136067.592357:0:3644:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789136067.592360:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4416de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876044587188096:0@lo:9:umount.0 00010000:00010000:1.0:1789136067.592363:0:17795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136067.592394:0:17796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1789136067.622955:0:21590:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff94a07549ced8) has no exports 00000020:01000000:2.0:1789136067.681865:0:21590:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff94a076693c60 - data ffff94a051a7eaf8/ffff94a07587d800 00000020:01000000:2.0:1789136067.682020:0:21590:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff949f4360df60 - data ffff94a06fd2eca8/ffff94a047180c00 00000001:00000004:2.0:1789136067.702265:0:21590:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:0.0:1789136067.745522:0:21590:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789136067.745531:0:21590:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789136067.745539:0:21590:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1789136067.746906:0:21590:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789136067.746911:0:21590:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:0.0:1789136067.746962:0:21590:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789136067.746965:0:21590:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1789136067.747461:0:18550:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1789136067.747466:0:18550:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:2.0:1789136067.747477:0:18550:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:0.0:1789136067.748041:0:21590:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789136067.748045:0:21590:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:0.0:1789136067.748062:0:21590:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789136067.748064:0:21590:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789136067.748284:0:18552:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789136067.748288:0:18552:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:1.0:1789136067.748296:0:18552:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:0.0:1789136067.749091:0:21590:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xedd53ca6b6e46975 00000020:00000080:0.0:1789136067.749101:0:21590:0:(genops.c:885:class_export_put()) final put ffff94a046a38000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789136067.749737:0:21590:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xedd53ca6b6e4698a 00000020:00000080:0.0:1789136067.749743:0:21590:0:(genops.c:885:class_export_put()) final put ffff94a062134000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1789136067.749748:0:21590:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:0.0:1789136067.749752:0:21590:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789136067.749760:0:21590:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789136067.749763:0:21590:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff94a07549b490) has no exports 00000020:00000080:1.0:1789136067.749888:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff94a046a38000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1789136067.749897:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff94a062134000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000004:01000000:0.0:1789136067.750062:0:21590:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1789136067.750075:0:21590:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xedd53ca6b6e469de 00000020:00000080:0.0:1789136067.750080:0:21590:0:(genops.c:885:class_export_put()) final put ffff94a06613e000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1789136067.750122:0:21590:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:0.0:1789136067.750126:0:21590:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789136067.750131:0:21590:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789136067.750134:0:21590:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff949f434e0000) has no exports 00000020:00000080:0.0:1789136067.750139:0:21590:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xedd53ca6b6e469d7 00000020:00000080:0.0:1789136067.750142:0:21590:0:(genops.c:885:class_export_put()) final put ffff94a07c6f3800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1789136067.750410:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff94a06613e000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00010000:01000000:0.0:1789136067.751022:0:21590:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:0.0:1789136067.751027:0:21590:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789136067.751030:0:21590:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:0.0:1789136067.751035:0:21590:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789136067.751038:0:21590:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789136067.751065:0:21590:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789136067.751072:0:21590:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789136067.751078:0:21590:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xedd53ca6b6e469c9 00000020:00000080:0.0:1789136067.751083:0:21590:0:(genops.c:885:class_export_put()) final put ffff94a043eed000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1789136067.751087:0:21590:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:0.0:1789136067.751090:0:21590:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789136067.751093:0:21590:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789136067.751096:0:21590:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff94a043764ed8) has no exports 00000020:00000080:0.0:1789136067.751100:0:21590:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xedd53ca6b6e469c2 00000020:00000080:0.0:1789136067.751103:0:21590:0:(genops.c:885:class_export_put()) final put ffff94a060ee0000/lustre-MDT0001-osd_UUID 00010000:01000000:0.0:1789136067.751403:0:21590:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:0.0:1789136067.751406:0:21590:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789136067.751408:0:21590:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:0.0:1789136067.751411:0:21590:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789136067.751413:0:21590:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789136067.751437:0:21590:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789136067.751441:0:21590:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:0.0:1789136067.751450:0:21590:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1789136067.751454:0:21590:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xedd53ca6b6e469ad 00000020:00000080:0.0:1789136067.751464:0:21590:0:(genops.c:885:class_export_put()) final put ffff94a046a3e800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1789136067.751468:0:21590:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:0.0:1789136067.751471:0:21590:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789136067.751474:0:21590:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789136067.751477:0:21590:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff949f42670000) has no exports 00000020:00000080:0.0:1789136067.751480:0:21590:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xedd53ca6b6e469a6 00000020:00000080:0.0:1789136067.751482:0:21590:0:(genops.c:885:class_export_put()) final put ffff949f439e7800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1789136067.751720:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff94a07c6f3800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1789136067.751729:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94a06613b800 for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1789136067.751735:0:37:0:(genops.c:885:class_export_put()) final put ffff94a043eec800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789136067.751737:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff94a043eec800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:1.0:1789136067.751741:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789136067.752511:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff94a043eed000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1789136067.752518:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff94a060ee0000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1789136067.752522:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94a060ee3800 for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1789136067.752527:0:37:0:(genops.c:885:class_export_put()) final put ffff94a043ee9800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789136067.752529:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff94a043ee9800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:1.0:1789136067.752532:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789136067.752568:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff94a046a3e800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1789136067.752573:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff949f439e7800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1789136067.752706:0:21590:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:1.0:1789136067.752710:0:21590:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789136067.752713:0:21590:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789136067.752717:0:21590:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789136067.752768:0:21590:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789136067.752776:0:21590:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789136067.752877:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff949f439e0000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1789136067.752884:0:37:0:(genops.c:885:class_export_put()) final put ffff94a0769e3800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789136067.752886:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff94a0769e3800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:2.0:1789136067.752890:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789136067.753033:0:21590:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789136067.753038:0:21590:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789136067.753052:0:21590:0:(genops.c:885:class_export_put()) final put ffff94a0769e0000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789136067.753054:0:21590:0:(genops.c:844:class_export_destroy()) destroying export ffff94a0769e0000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:1.0:1789136067.753059:0:21590:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789136067.753149:0:21590:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xedd53ca6b6e46991 00000020:00000080:1.0:1789136067.753155:0:21590:0:(genops.c:885:class_export_put()) final put ffff94a062136000/lustre-MDD0001_UUID 00000020:01000000:1.0:1789136067.753465:0:21590:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:1.0:1789136067.753470:0:21590:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789136067.753474:0:21590:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789136067.753478:0:21590:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff94a043760000) has no exports 00000020:00000080:1.0:1789136067.753498:0:21590:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789136067.753501:0:21590:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:1.0:1789136067.753504:0:21590:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xedd53ca6b6e46998 00000020:00000080:1.0:1789136067.753508:0:21590:0:(genops.c:885:class_export_put()) final put ffff94a062131800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1789136067.753960:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff94a062136000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:2.0:1789136067.753965:0:37:0:(genops.c:885:class_export_put()) final put ffff94a043eed800/lustre-MDD0001_UUID 00000020:00000080:2.0:1789136067.753967:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff94a043eed800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:2.0:1789136067.753972:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:01000004:1.0:1789136067.754178:0:21590:0:(tgt_mount.c:187:server_put_mount()) put mount ffff94a081a9f800 from lustre-MDT0001, refs=2 00000020:01000004:1.0:1789136067.754182:0:21590:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94a081a9f800 2 00000020:01000004:1.0:1789136067.754186:0:21590:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff94a081a9f800 from lustre-MDT0001 00000020:00000080:1.0:1789136067.754215:0:21590:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789136067.754220:0:21590:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:1.0:1789136067.754223:0:21590:0:(genops.c:885:class_export_put()) final put ffff94a046a3f000/lustre-MDT0001_UUID 00000020:00000080:1.0:1789136067.754225:0:21590:0:(genops.c:844:class_export_destroy()) destroying export ffff94a046a3f000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:1.0:1789136067.754233:0:21590:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:1.0:1789136067.754272:0:21590:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:1.0:1789136067.754276:0:21590:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:1.0:1789136067.754279:0:21590:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789136067.754283:0:21590:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789136067.754290:0:21590:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff94a04540d800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789136067.754295:0:21590:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff94a043763490) has exports, disconnecting them 00000020:00080000:1.0:1789136067.754299:0:21590:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff94a04540d800), last request at 1789135989 00000020:00000080:1.0:1789136067.754302:0:21590:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xedd53ca6b6e46a16 00000020:00080000:1.0:1789136067.754313:0:21590:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff94a04540d800): rc 0 00000020:00000080:1.0:1789136067.754317:0:21590:0:(genops.c:885:class_export_put()) final put ffff94a04540d800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1789136067.754887:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff94a062131800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1789136067.754894:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff94a04540d800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:2.0:1789136067.768718:0:21590:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:2.0:1789136067.768726:0:21590:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789136067.768730:0:21590:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789136067.768737:0:21590:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789136067.768762:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94a052ad5800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1789136067.768945:0:21590:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789136067.768952:0:21590:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:2.0:1789136067.768958:0:21590:0:(genops.c:885:class_export_put()) final put ffff94a04350c800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:2.0:1789136067.768962:0:21590:0:(genops.c:844:class_export_destroy()) destroying export ffff94a04350c800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:2.0:1789136067.768971:0:21590:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:2.0:1789136067.769034:0:21590:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94a081a9f800 1 00000020:00000080:2.0:1789136067.769039:0:21590:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xedd53ca6b6e4693d 00000020:00000080:2.0:1789136067.769044:0:21590:0:(genops.c:885:class_export_put()) final put ffff94a07654b000/lustre-MDT0001-osd_UUID 00000020:01000000:2.0:1789136067.769052:0:21590:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:2.0:1789136067.769060:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff94a07654b000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1789136067.769068:0:21590:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789136067.769081:0:21590:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789136067.769085:0:21590:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff949f42674ed8) has no exports 00000020:00000080:2.0:1789136067.821601:0:21590:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789136067.821615:0:21590:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:2.0:1789136067.821621:0:21590:0:(genops.c:885:class_export_put()) final put ffff94a081a9a000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1789136067.821642:0:21590:0:(genops.c:844:class_export_destroy()) destroying export ffff94a081a9a000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:2.0:1789136067.821653:0:21590:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:2.0:1789136067.821760:0:21590:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff94a081a9e800 00000020:01000000:2.0:1789136067.821778:0:21590:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1789136067.821782:0:21590:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789136067.821785:0:21590:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789136067.821806:0:21590:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff94a049079a48) has no exports 00000100:00100000:3.0:1789136067.822119:0:17807:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff949f43729000:17807] 1 exiting: rc = 0 00000100:00100000:2.0:1789136067.822245:0:20771:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff949f4287d400:20771] 3 exiting: rc = 0 00000100:00100000:0.0:1789136067.822357:0:17806:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff949f43728200:17806] 0 exiting: rc = 1 00000100:00100000:0.0:1789136067.822425:0:17808:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff949f437b1e00:17808] 2 exiting: rc = 0 00000100:00100000:2.0:1789136067.822706:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136067.822715:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136067.822721:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136067.822725:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136067.822731:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136067.822737:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136067.822743:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136067.822748:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136067.822753:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136067.822760:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136067.822767:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136067.822772:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136067.822778:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136067.822783:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136067.822853:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136067.822861:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136067.822866:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136067.822872:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136067.822877:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136067.822882:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136067.822887:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136067.822903:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136067.822908:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136067.822913:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136067.822917:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136067.822922:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136067.822926:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136067.822931:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136067.822935:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136067.822940:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136067.822946:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136067.822951:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136067.822955:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136067.822960:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136067.822964:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136067.822969:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136067.822974:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136067.822978:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136067.822983:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136067.822988:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136067.822992:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136067.822996:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136067.823001:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136067.823004:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136067.823009:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136067.823014:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136067.823019:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136067.823023:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136067.823028:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136067.823033:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136067.823037:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136067.823042:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136067.823047:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136067.823051:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136067.823057:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136067.823062:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136067.823076:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136067.823082:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136067.823087:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136067.823091:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136067.823096:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136067.823101:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136067.823107:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136067.823113:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.826499:0:17809:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff949f437b0600:17809] 0 exiting: rc = 1 00000100:00100000:1.0:1789136067.826595:0:17810:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff94a075464a00:17810] 1 exiting: rc = 0 00000100:00100000:3.0:1789136067.826726:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136067.826735:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136067.826741:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136067.826747:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136067.826752:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136067.826757:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136067.826761:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136067.826766:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136067.826770:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136067.826774:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136067.826779:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136067.826783:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136067.826901:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136067.826910:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136067.826914:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136067.826918:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136067.826923:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136067.826927:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136067.826931:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136067.826936:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136067.826941:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136067.826946:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136067.826950:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136067.826955:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136067.826960:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136067.826964:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136067.826969:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136067.826974:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136067.826978:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136067.826996:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136067.827000:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136067.827004:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136067.827009:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136067.827013:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136067.827018:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136067.827022:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136067.827027:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136067.827031:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136067.827036:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136067.827040:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136067.827045:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136067.827049:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136067.827053:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136067.827057:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136067.827061:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136067.827066:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136067.827070:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136067.827075:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136067.827079:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136067.827083:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136067.827088:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136067.827092:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136067.827097:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136067.827102:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136067.827106:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136067.827110:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136067.827115:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136067.827119:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136067.827123:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136067.827128:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136067.827132:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136067.827136:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136067.827142:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136067.827147:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136067.829163:0:17812:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff94a046a04a00:17812] 1 exiting: rc = 0 00000100:00100000:2.0:1789136067.829316:0:20772:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff94a0758d6400:20772] 2 exiting: rc = 0 00000100:00100000:2.0:1789136067.829413:0:17811:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff94a05160a800:17811] 0 exiting: rc = 1 00000100:00100000:1.0:1789136067.829483:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.829491:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.829498:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.829516:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.829522:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.829527:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.829532:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.829539:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.829544:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.829550:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.829556:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.829573:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.829580:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.829586:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.829591:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.829597:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.829603:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.829610:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.829616:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.829621:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.829974:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.829983:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.829989:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.830008:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.830014:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.830020:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.830026:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.830032:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.830038:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.830043:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.830049:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.830055:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.830062:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.830067:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.830073:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.830093:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.830101:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.830108:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.830122:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.830129:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.830135:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.830141:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.830148:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.830155:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.830161:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.830167:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.830173:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.830197:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.830204:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.830211:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.830218:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.830224:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.830230:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.830236:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.830243:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.830249:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.830255:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.830262:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.830268:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.830289:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.830296:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.830304:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.830310:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.830316:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136067.838265:0:17814:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff94a046a05200:17814] 1 exiting: rc = 0 00000100:00100000:2.0:1789136067.838421:0:17813:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff94a046a04e00:17813] 0 exiting: rc = 1 00000100:00100000:1.0:1789136067.838528:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.838536:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.838541:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.838546:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.838552:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.838557:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.838562:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.838567:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.838571:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.838588:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.838594:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.838598:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.838604:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.838609:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.838615:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.838620:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.838880:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.838889:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.838894:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.838899:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.838904:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.838908:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.838913:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.838918:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.838922:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.838926:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.838930:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.838935:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.838940:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.838944:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.838949:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.838953:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.838958:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.838963:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.838968:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.838973:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.838978:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.838983:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.838989:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.838994:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.838998:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.839004:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.839009:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.839013:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.839026:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.839030:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.839035:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.839040:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.839044:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.839049:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.839054:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.839059:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.839063:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.839069:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.839074:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.839080:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.839085:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.839089:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.839094:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.839100:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.839105:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.839111:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.839116:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.839121:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136067.839484:0:17816:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff94a046a04c00:17816] 1 exiting: rc = 0 00000100:00100000:2.0:1789136067.839609:0:17815:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff94a046a05800:17815] 0 exiting: rc = 1 00000100:00100000:1.0:1789136067.839887:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.839893:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.839898:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.839904:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.839910:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.839914:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.839920:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.839925:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.839930:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.839936:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.839941:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.839946:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.839950:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.839955:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.839960:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.839974:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.839979:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.839984:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.839989:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.839995:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.840000:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.840004:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.840009:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.840014:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.840019:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.840024:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.840029:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.840034:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.840039:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.840043:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.840048:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.840053:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.840058:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.840063:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.840068:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.840073:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.840077:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.840082:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.840087:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.840093:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.840098:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.840102:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.840107:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.840112:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.840117:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.840122:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.840126:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.840131:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.840136:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.840142:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.840154:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.840159:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.840163:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.840168:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.840172:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.840176:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.840181:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.840185:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.840189:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.840194:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.840198:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.840203:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.840207:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.840212:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136067.840528:0:17818:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff94a0469f3600:17818] 1 exiting: rc = 0 00000100:00100000:2.0:1789136067.840686:0:17817:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff94a0469f3200:17817] 0 exiting: rc = 1 00000100:00100000:1.0:1789136067.840881:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.840887:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.840892:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.840897:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.840902:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.840908:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.840913:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.840918:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.840923:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.840928:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.840933:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.840938:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.840943:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.840948:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.840954:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.840959:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.840964:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.840969:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.840974:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.840979:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.840984:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.840999:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.841003:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.841008:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.841012:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.841017:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.841022:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.841027:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.841032:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.841037:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.841042:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.841047:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.841052:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.841056:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.841061:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.841066:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.841071:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.841076:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.841081:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.841085:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.841091:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.841096:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.841100:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.841105:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.841109:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.841114:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.841118:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.841122:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.841127:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.841132:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.841137:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.841142:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.841146:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.841151:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.841155:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.841160:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.841175:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.841180:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.841184:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.841188:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.841193:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.841197:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.841201:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.841205:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136067.842244:0:17820:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff94a0469f2800:17820] 1 exiting: rc = 0 00000100:00100000:2.0:1789136067.842681:0:17819:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff94a0469f2e00:17819] 0 exiting: rc = 1 00000100:00100000:2.0:1789136067.843047:0:17821:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff94a0469f3800:17821] 2 exiting: rc = 0 00000100:00100000:1.0:1789136067.843175:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.843182:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.843189:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.843194:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.843200:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.843215:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.843240:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.843247:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.843253:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.843259:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.843265:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.843270:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.843277:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.843283:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.843288:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.843294:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.843300:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.843306:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.843312:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.843317:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.843323:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.843329:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.843335:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.843341:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.843346:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.843352:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.843357:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.843374:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.843379:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.843385:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.843406:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.843413:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.843419:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.843424:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.843430:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.843435:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.843440:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.843445:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.843450:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.843456:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.843460:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.843465:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.843470:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.843476:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.843482:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.843487:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.843494:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.843500:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.843506:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.843511:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.843517:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.843523:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.843529:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.843535:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.843556:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.843563:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.843567:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.843573:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.843578:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.843584:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.843590:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.843595:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.843609:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136067.843615:0:21590:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1789136067.847906:0:21590:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789136067.847918:0:21590:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1789136067.847923:0:21590:0:(genops.c:885:class_export_put()) final put ffff949f44884800/MDS_uuid 00000020:00000080:1.0:1789136067.847928:0:21590:0:(genops.c:844:class_export_destroy()) destroying export ffff949f44884800/MDS_uuid for MDS 00000020:01000000:1.0:1789136067.847938:0:21590:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1789136067.848073:0:21590:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:3.0:1789136068.337757:0:21390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789136069.110018:0:20133:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789136069.110026:0:20133:0:(genops.c:885:class_export_put()) final put ffff949f43796000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1789136069.110041:0:20133:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789136069.110043:0:20133:0:(genops.c:885:class_export_put()) final put ffff949f43790800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789136069.110150:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff949f43796000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1789136069.110200:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff949f43790800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1789136069.110223:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff949f43795800 for lustre-OST0001 00000020:00000080:1.0:1789136069.110228:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff949f43794800 for lustre-OST0001 00010000:00010000:1.0:1789136069.361999:0:17795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136070.384985:0:17796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136071.428482:0:21390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789136071.536490:0:21791:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1789136071.562382:0:21791:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1789136071.562433:0:21791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a043131400/0xedd53ca6b6e46ab0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e46ab7 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136071.562447:0:21791:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a043131400/0xedd53ca6b6e46ab0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xedd53ca6b6e46ab7 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136071.562454:0:21791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a043131400/0xedd53ca6b6e46ab0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xedd53ca6b6e46ab7 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136071.562460:0:21791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.156@tcp lock: ffff94a043131400/0xedd53ca6b6e46ab0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xedd53ca6b6e46ab7 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136071.562480:0:21791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789136071.562485:0:21791:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789136071.562513:0:21791:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789136071.562517:0:21791:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789136071.562523:0:21791:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789136071.562541:0:21791:0:(import.c:65:import_set_state_nolock()) ffff94a07021f000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1789136071.562546:0:21791:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789136071.562548:0:21791:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789136071.562551:0:21791:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1789136071.563444:0:21791:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789136071.563449:0:21791:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789136071.563454:0:21791:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1789136071.563474:0:21791:0:(import.c:65:import_set_state_nolock()) ffff94a046a3c800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1789136071.563574:0:17795:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789136071.563582:0:17795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.156@tcp lock: ffff94a043131400/0xedd53ca6b6e46ab0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xedd53ca6b6e46ab7 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136071.563591:0:17795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a043131400 already unused, calling callback (ffffffffc13c2c20) 10000000:00010000:1.0:1789136071.563595:0:17795:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.156@tcp lock: ffff94a043131400/0xedd53ca6b6e46ab0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xedd53ca6b6e46ab7 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136071.563604:0:17795:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.156@tcp lock: ffff94a043131400/0xedd53ca6b6e46ab0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xedd53ca6b6e46ab7 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789136071.563612:0:17795:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.156@tcp lock: ffff94a043131400/0xedd53ca6b6e46ab0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xedd53ca6b6e46ab7 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789136071.563618:0:17795:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789136071.563620:0:17795:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789136071.563623:0:17795:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789136071.563661:0:17795:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff949f4486c800 00010000:00010000:1.0:1789136071.563675:0:17795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.156@tcp lock: ffff94a043131400/0xedd53ca6b6e46ab0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xedd53ca6b6e46ab7 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136071.563684:0:17795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.156@tcp lock: ffff94a043131400/0xedd53ca6b6e46ab0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xedd53ca6b6e46ab7 expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136071.563697:0:17795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136071.563699:0:17795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136071.563701:0:17795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136071.564353:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07ad983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1876044587188224:0@lo:39:umount.0 00000400:00000100:3.0:1789136071.564402:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876044587188224 offset 0 length 224: 4 00000100:00080000:2.0:1789136072.177175:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60cac2b7-c8b7-48ce-aa29-b6da8d73b5ee->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789136072.177185:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60cac2b7-c8b7-48ce-aa29-b6da8d73b5ee->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789136072.177188:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789136072.177191:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789136072.177195:0:37:0:(import.c:65:import_set_state_nolock()) ffff949f449c9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789136072.177203:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 605 00000100:00080000:2.0:1789136072.177208:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789136072.177215:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff949f449c9800 using connection 192.168.206.156@tcp/0@lo 00000100:00100000:2.0:1789136072.177253:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94a06f1a7480 x1876044587188352/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789136072.177394:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789136072.177403:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a06f1a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1876044587188352:0@lo:38:kworker.0 00000100:00100000:0.0:1789136072.177407:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a06f1a4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876044587188480:0@lo:400:kworker.0 00000400:00000100:3.0:1789136072.177452:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876044587188352 offset 0 length 520: 4 00000400:00000100:0.0:1789136072.177507:0:3645:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876044587188480 offset 0 length 224: 4 00010000:00010000:1.0:1789136072.433504:0:17796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789136072.691350:0:19313:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789136072.691358:0:19313:0:(genops.c:885:class_export_put()) final put ffff94a046a3b000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789136072.691442:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff94a046a3b000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1789136072.697942:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94a046a3d000 for lustre-OST0000 00010000:00010000:3.0:1789136073.458065:0:21390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136074.481755:0:17795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136075.506557:0:17796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136076.529445:0:21390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789136077.296754:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60cac2b7-c8b7-48ce-aa29-b6da8d73b5ee->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789136077.296790:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60cac2b7-c8b7-48ce-aa29-b6da8d73b5ee->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789136077.296793:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789136077.296796:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789136077.296814:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789136067/real 1789136067] req@ffff94a07ad9a1c0 x1876044587187840/t0(0) o250->MGC192.168.206.156@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789136077 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136077.296847:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff94a07ad9a1c0 x1876044587187840/t0(0) o250->MGC192.168.206.156@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789136077 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789136077.296868:0:3644:0:(import.c:65:import_set_state_nolock()) ffff949f4486c800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789136077.296879:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00080000:2.0:1789136077.296885:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60cac2b7-c8b7-48ce-aa29-b6da8d73b5ee->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1789136077.296885:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07ad9a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60cac2b7-c8b7-48ce-aa29-b6da8d73b5ee:3644:1876044587187840:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:2.0:1789136077.296894:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1789136077.296898:0:8:0:(import.c:65:import_set_state_nolock()) ffff949f4486c800 MGS: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1789136077.296919:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a06f1a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876044587188608:0@lo:400:kworker.0 00000400:00000100:1.0:1789136077.296976:0:3647:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876044587188608 offset 0 length 224: 4 00000100:00080000:2.0:1789136077.302742:0:8:0:(import.c:510:import_select_connection()) MGC192.168.206.156@tcp: connect to NID 0@lo last attempt 605 00000100:00080000:2.0:1789136077.303000:0:8:0:(import.c:589:import_select_connection()) MGC192.168.206.156@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789136077.303008:0:8:0:(import.c:624:import_select_connection()) MGC192.168.206.156@tcp: import ffff949f4486c800 using connection 192.168.206.156@tcp/0@lo 00000100:00100000:2.0:1789136077.303043:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94a06f1a5e00 x1876044587188736/t0(0) o250->MGC192.168.206.156@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789136077.303070:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789136077.303074:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789136077.303532:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a06f1a5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60cac2b7-c8b7-48ce-aa29-b6da8d73b5ee:3644:1876044587188736:0@lo:250:kworker.0 00000400:00000100:0.0:1789136077.303582:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876044587188736 offset 0 length 520: 4 00010000:00010000:1.0:1789136077.552880:0:17795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136078.576992:0:17796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136079.600840:0:21390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136080.625726:0:17795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136081.394908:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789136071/real 1789136071] req@ffff94a07ad983c0 x1876044587188224/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789136081 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136081.394936:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff94a07ad983c0 x1876044587188224/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789136081 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789136081.394959:0:3644:0:(import.c:65:import_set_state_nolock()) ffff94a046a3c800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1789136081.394979:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07ad983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1876044587188224:0@lo:39:umount.0 00000100:00080000:0.0:1789136081.395051:0:21791:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789136081.395055:0:21791:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789136081.395060:0:21791:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789136081.396156:0:21791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.156@tcp lock: ffff949f44248800/0xedd53ca6b6e46a86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e46a8d expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136081.396174:0:21791:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.156@tcp lock: ffff949f44248800/0xedd53ca6b6e46a86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xedd53ca6b6e46a8d expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136081.396181:0:21791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.156@tcp lock: ffff949f44248800/0xedd53ca6b6e46a86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xedd53ca6b6e46a8d expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136081.396188:0:21791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.156@tcp lock: ffff949f44248800/0xedd53ca6b6e46a86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xedd53ca6b6e46a8d expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136081.396884:0:21791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789136081.396897:0:21791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.156@tcp lock: ffff949f43a18a00/0xedd53ca6b6e46ddc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e46de3 expref: -99 pid: 17803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136081.396906:0:21791:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.156@tcp lock: ffff949f43a18a00/0xedd53ca6b6e46ddc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xedd53ca6b6e46de3 expref: -99 pid: 17803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136081.396913:0:21791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.156@tcp lock: ffff949f43a18a00/0xedd53ca6b6e46ddc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xedd53ca6b6e46de3 expref: -99 pid: 17803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136081.396918:0:21791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.156@tcp lock: ffff949f43a18a00/0xedd53ca6b6e46ddc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xedd53ca6b6e46de3 expref: -99 pid: 17803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136081.403430:0:17796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789136081.403444:0:17796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.156@tcp lock: ffff949f44248800/0xedd53ca6b6e46a86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xedd53ca6b6e46a8d expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136081.403456:0:17796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff949f44248800 already unused, calling callback (ffffffffc13c2c20) 10000000:00010000:1.0:1789136081.403460:0:17796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.156@tcp lock: ffff949f44248800/0xedd53ca6b6e46a86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xedd53ca6b6e46a8d expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136081.403472:0:17796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.156@tcp lock: ffff949f44248800/0xedd53ca6b6e46a86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xedd53ca6b6e46a8d expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789136081.403479:0:17796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.156@tcp lock: ffff949f44248800/0xedd53ca6b6e46a86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xedd53ca6b6e46a8d expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789136081.403506:0:17796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789136081.403509:0:17796:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:1.0:1789136081.403523:0:17796:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff949f4486c800 00010000:00010000:1.0:1789136081.403527:0:17796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.156@tcp lock: ffff949f44248800/0xedd53ca6b6e46a86 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xedd53ca6b6e46a8d expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136081.403534:0:17796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.156@tcp lock: ffff949f44248800/0xedd53ca6b6e46a86 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xedd53ca6b6e46a8d expref: -99 pid: 19312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136081.403551:0:17796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789136081.403555:0:17796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.156@tcp lock: ffff949f43a18a00/0xedd53ca6b6e46ddc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xedd53ca6b6e46de3 expref: -99 pid: 17803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136081.403573:0:17796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff949f43a18a00 already unused, calling callback (ffffffffc13c2c20) 10000000:00010000:1.0:1789136081.403576:0:17796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.156@tcp lock: ffff949f43a18a00/0xedd53ca6b6e46ddc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xedd53ca6b6e46de3 expref: -99 pid: 17803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136081.403582:0:17796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.156@tcp lock: ffff949f43a18a00/0xedd53ca6b6e46ddc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xedd53ca6b6e46de3 expref: -99 pid: 17803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789136081.403589:0:17796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.156@tcp lock: ffff949f43a18a00/0xedd53ca6b6e46ddc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xedd53ca6b6e46de3 expref: -99 pid: 17803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789136081.403594:0:17796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789136081.403596:0:17796:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1789136081.403601:0:17796:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff949f4486c800 00010000:00010000:1.0:1789136081.403604:0:17796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.156@tcp lock: ffff949f43a18a00/0xedd53ca6b6e46ddc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xedd53ca6b6e46de3 expref: -99 pid: 17803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136081.403624:0:17796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136081.403668:0:17796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136081.403672:0:17796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136081.409260:0:21791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789136081.409275:0:21791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.156@tcp lock: ffff949f43a18a00/0xedd53ca6b6e46ddc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xedd53ca6b6e46de3 expref: -99 pid: 17803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789136081.409295:0:21791:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:0.0:1789136081.409319:0:21791:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:0.0:1789136081.409321:0:21791:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1789136081.409357:0:21791:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1789136081.409361:0:21791:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1789136081.409367:0:21791:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789136081.409373:0:21791:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789136081.409377:0:21791:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff949f44323490) has no exports 00000020:00080000:0.0:1789136081.409479:0:21791:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff949f44323490) has no exports 00010000:00010000:3.0:1789136081.410952:0:21390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1789136081.414264:0:21791:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff94a0435be300 - data ffff94a06fc63ca8/ffff94a07f611800 00000020:01000000:0.0:1789136081.414418:0:21791:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff949f438c6300 - data ffff949f4207c000/ffff949f41f2e400 00100000:10000000:0.0:1789136081.433882:0:21791:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1789136081.449923:0:21791:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xedd53ca6b6e46a9b 00000020:00000080:1.0:1789136081.449934:0:21791:0:(genops.c:885:class_export_put()) final put ffff94a081820000/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1789136081.449945:0:21791:0:(tgt_mount.c:187:server_put_mount()) put mount ffff94a04540a000 from lustre-OST0000, refs=2 00000020:01000004:1.0:1789136081.449948:0:21791:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94a04540a000 2 00000020:01000004:1.0:1789136081.449951:0:21791:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff94a04540a000 from lustre-OST0000 00000020:00000080:1.0:1789136081.449972:0:21791:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789136081.449980:0:21791:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1789136081.449982:0:21791:0:(genops.c:885:class_export_put()) final put ffff94a081823000/lustre-OST0000_UUID 00000020:00000080:1.0:1789136081.449985:0:21791:0:(genops.c:844:class_export_destroy()) destroying export ffff94a081823000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1789136081.449991:0:21791:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1789136081.450037:0:21791:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1789136081.450042:0:21791:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1789136081.450046:0:21791:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789136081.450050:0:21791:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789136081.450057:0:21791:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff94a049054800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789136081.450062:0:21791:0:(genops.c:1553:class_disconnect_exports()) OBD device 23 (ffff949f44318000) has exports, disconnecting them 00000020:00080000:1.0:1789136081.450066:0:21791:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff94a049054800), last request at 1789136005 00000020:00000080:1.0:1789136081.450070:0:21791:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xedd53ca6b6e46ac5 00000020:00080000:1.0:1789136081.450080:0:21791:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff94a049054800): rc 0 00000020:00000080:1.0:1789136081.450084:0:21791:0:(genops.c:885:class_export_put()) final put ffff94a049054800/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1789136081.450506:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff94a081820000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1789136081.450514:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff94a049054800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1789136081.452692:0:21791:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1789136081.452699:0:21791:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789136081.452703:0:21791:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789136081.452709:0:21791:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789136081.452917:0:21791:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789136081.452925:0:21791:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1789136081.452930:0:21791:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1789136081.452934:0:21791:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789136081.452938:0:21791:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789136081.452944:0:21791:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff94a046a3e000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789136081.452951:0:21791:0:(genops.c:1553:class_disconnect_exports()) OBD device 24 (ffff949f434e4ed8) has exports, disconnecting them 00000020:00080000:0.0:1789136081.452955:0:21791:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff94a046a3e000), last request at 1789136005 00000020:00000080:0.0:1789136081.452958:0:21791:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xedd53ca6b6e46ada 00000020:00080000:0.0:1789136081.452970:0:21791:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff94a046a3e000): rc 0 00000020:00000080:0.0:1789136081.452975:0:21791:0:(genops.c:885:class_export_put()) final put ffff94a046a3e000/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1789136081.453135:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94a07021f000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1789136081.453143:0:8:0:(genops.c:885:class_export_put()) final put ffff94a049057800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1789136081.453146:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff94a049057800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1789136081.453157:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1789136081.454746:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff94a046a3e000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:1.0:1789136081.467998:0:21791:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:1.0:1789136081.468007:0:21791:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789136081.468012:0:21791:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789136081.468019:0:21791:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789136081.468162:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94a046a3c800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1789136081.468218:0:21791:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789136081.468236:0:21791:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:1.0:1789136081.468241:0:21791:0:(genops.c:885:class_export_put()) final put ffff94a070219000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1789136081.468245:0:21791:0:(genops.c:844:class_export_destroy()) destroying export ffff94a070219000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1789136081.468251:0:21791:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:1.0:1789136081.468308:0:21791:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94a04540a000 1 00000020:00000080:1.0:1789136081.468313:0:21791:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xedd53ca6b6e46a78 00000020:00000080:1.0:1789136081.468319:0:21791:0:(genops.c:885:class_export_put()) final put ffff94a052bf5800/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1789136081.468324:0:21791:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1789136081.468327:0:21791:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789136081.468331:0:21791:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789136081.468335:0:21791:0:(genops.c:1558:class_disconnect_exports()) OBD device 20 (ffff94a043761a48) has no exports 00000020:00000080:3.0:1789136081.468378:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff94a052bf5800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1789136081.502587:0:21791:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789136081.502599:0:21791:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1789136081.502604:0:21791:0:(genops.c:885:class_export_put()) final put ffff94a04540c800/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1789136081.502608:0:21791:0:(genops.c:844:class_export_destroy()) destroying export ffff94a04540c800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1789136081.502619:0:21791:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1789136081.503142:0:21791:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff94a045409000 00000020:02000400:2.0:1789136081.503198:0:21791:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1789136081.652072:0:17795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789136082.418590:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60cac2b7-c8b7-48ce-aa29-b6da8d73b5ee->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789136082.418604:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60cac2b7-c8b7-48ce-aa29-b6da8d73b5ee->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789136082.418607:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789136082.418610:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789136082.418687:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07ad9a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1876044587188864:0@lo:400:kworker.0 00000400:00000100:0.0:1789136082.418746:0:3648:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876044587188864 offset 0 length 224: 4 00010000:00010000:1.0:1789136082.672966:0:17796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136083.696918:0:21390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136084.722680:0:17795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789136084.983713:0:21993:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1789136085.003792:0:21993:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1789136085.003904:0:21993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a07a32c000/0xedd53ca6b6e46c0e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e46c15 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136085.003922:0:21993:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a07a32c000/0xedd53ca6b6e46c0e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xedd53ca6b6e46c15 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136085.003931:0:21993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a07a32c000/0xedd53ca6b6e46c0e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xedd53ca6b6e46c15 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136085.003939:0:21993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.156@tcp lock: ffff94a07a32c000/0xedd53ca6b6e46c0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xedd53ca6b6e46c15 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136085.003969:0:21993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789136085.003976:0:21993:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789136085.004013:0:21993:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789136085.004028:0:21993:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff94a06f1a7480 x1876044587188352/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789136087 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136085.004063:0:21993:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789136085.004071:0:21993:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789136085.004080:0:21993:0:(import.c:65:import_set_state_nolock()) ffff949f449c9800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1789136085.004086:0:21993:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789136085.004090:0:21993:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff94a06f1a7480 x1876044587188352/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789136087 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136085.004097:0:21993:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789136085.004101:0:21993:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000100:00100000:3.0:1789136085.004857:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a06f1a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1876044587188352:0@lo:38:kworker.0 00010000:00010000:0.0:1789136085.005485:0:17796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789136085.005497:0:17796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.156@tcp lock: ffff94a07a32c000/0xedd53ca6b6e46c0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xedd53ca6b6e46c15 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136085.005520:0:17796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a07a32c000 already unused, calling callback (ffffffffc13c2c20) 10000000:00010000:0.0:1789136085.005525:0:17796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.156@tcp lock: ffff94a07a32c000/0xedd53ca6b6e46c0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xedd53ca6b6e46c15 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136085.005536:0:17796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.156@tcp lock: ffff94a07a32c000/0xedd53ca6b6e46c0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xedd53ca6b6e46c15 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789136085.005544:0:17796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.156@tcp lock: ffff94a07a32c000/0xedd53ca6b6e46c0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xedd53ca6b6e46c15 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789136085.005551:0:17796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789136085.005554:0:17796:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789136085.005557:0:17796:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789136085.005575:0:17796:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff949f4486c800 00010000:00010000:0.0:1789136085.005579:0:17796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.156@tcp lock: ffff94a07a32c000/0xedd53ca6b6e46c0e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xedd53ca6b6e46c15 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136085.005604:0:17796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.156@tcp lock: ffff94a07a32c000/0xedd53ca6b6e46c0e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xedd53ca6b6e46c15 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136085.005619:0:17796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136085.005621:0:17796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136085.005622:0:17796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789136085.009174:0:21993:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789136085.009198:0:21993:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff94a06f1a4780 x1876044587188480/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136088 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136085.009222:0:21993:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff94a06f1a4000 x1876044587188608/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136093 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136085.009246:0:21993:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff94a07ad9a1c0 x1876044587188864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136098 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136085.009265:0:21993:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789136085.009274:0:21993:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1789136085.009312:0:21993:0:(import.c:65:import_set_state_nolock()) ffff949f4286a000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1789136085.009455:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a06f1a4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876044587188480:0@lo:400:kworker.0 00000100:00100000:3.0:1789136085.009667:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07ad9a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1876044587188864:0@lo:400:kworker.0 00000100:00100000:3.0:1789136085.009722:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4416c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1876044587188992:0@lo:39:umount.0 00000400:00000100:3.0:1789136085.009785:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876044587188992 offset 0 length 224: 4 00000100:00100000:2.0:1789136085.010052:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a06f1a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876044587188608:0@lo:400:kworker.0 00010000:00010000:0.0:1789136085.745541:0:21390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136086.772541:0:17795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789136087.538676:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60cac2b7-c8b7-48ce-aa29-b6da8d73b5ee->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789136087.538699:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 60cac2b7-c8b7-48ce-aa29-b6da8d73b5ee->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1789136087.793735:0:17796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136088.816842:0:21390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136089.841590:0:17795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136090.864865:0:17796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136091.889383:0:21390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136092.208765:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789136077/real 1789136077] req@ffff94a06f1a5e00 x1876044587188736/t0(0) o250->MGC192.168.206.156@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789136092 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136092.208800:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff94a06f1a5e00 x1876044587188736/t0(0) o250->MGC192.168.206.156@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789136092 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789136092.208820:0:3644:0:(import.c:65:import_set_state_nolock()) ffff949f4486c800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789136092.208846:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1789136092.208850:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a06f1a5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60cac2b7-c8b7-48ce-aa29-b6da8d73b5ee:3644:1876044587188736:0@lo:250:kworker.0 00000100:00080000:0.0:1789136092.208992:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) 60cac2b7-c8b7-48ce-aa29-b6da8d73b5ee->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789136092.208998:0:479:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1789136092.209001:0:479:0:(import.c:65:import_set_state_nolock()) ffff949f4486c800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789136092.209006:0:479:0:(import.c:510:import_select_connection()) MGC192.168.206.156@tcp: connect to NID 0@lo last attempt 615 00000100:00080000:0.0:1789136092.209011:0:479:0:(import.c:589:import_select_connection()) MGC192.168.206.156@tcp: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789136092.209018:0:479:0:(import.c:624:import_select_connection()) MGC192.168.206.156@tcp: import ffff949f4486c800 using connection 192.168.206.156@tcp/0@lo 00000100:00100000:0.0:1789136092.209051:0:479:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94a07ad99e00 x1876044587189120/t0(0) o250->MGC192.168.206.156@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789136092.209452:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07ad99e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60cac2b7-c8b7-48ce-aa29-b6da8d73b5ee:3644:1876044587189120:0@lo:250:kworker.0 00000400:00000100:3.0:1789136092.209500:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876044587189120 offset 0 length 520: 4 00010000:00010000:0.0:1789136092.912831:0:17795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136093.939550:0:17796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136094.961699:0:21390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136095.281137:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789136085/real 1789136085] req@ffff949f4416c3c0 x1876044587188992/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789136095 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136095.281186:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff949f4416c3c0 x1876044587188992/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789136095 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789136095.281205:0:3644:0:(import.c:65:import_set_state_nolock()) ffff949f4286a000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1789136095.281223:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4416c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1876044587188992:0@lo:39:umount.0 00000100:00080000:1.0:1789136095.281454:0:21993:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789136095.281459:0:21993:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789136095.281463:0:21993:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1789136095.283311:0:21993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.156@tcp lock: ffff949f4483c000/0xedd53ca6b6e46be4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e46beb expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136095.283332:0:21993:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.156@tcp lock: ffff949f4483c000/0xedd53ca6b6e46be4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xedd53ca6b6e46beb expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136095.283355:0:21993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.156@tcp lock: ffff949f4483c000/0xedd53ca6b6e46be4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xedd53ca6b6e46beb expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136095.283361:0:21993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.156@tcp lock: ffff949f4483c000/0xedd53ca6b6e46be4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xedd53ca6b6e46beb expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136095.283390:0:21993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789136095.283398:0:21993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.156@tcp lock: ffff949f43a18c00/0xedd53ca6b6e46dce lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e46dd5 expref: -99 pid: 17803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136095.283865:0:21993:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.156@tcp lock: ffff949f43a18c00/0xedd53ca6b6e46dce lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xedd53ca6b6e46dd5 expref: -99 pid: 17803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136095.283871:0:21993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.156@tcp lock: ffff949f43a18c00/0xedd53ca6b6e46dce lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xedd53ca6b6e46dd5 expref: -99 pid: 17803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136095.283877:0:21993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.156@tcp lock: ffff949f43a18c00/0xedd53ca6b6e46dce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xedd53ca6b6e46dd5 expref: -99 pid: 17803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136095.283903:0:21993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1789136095.283909:0:21993:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1789136095.283947:0:21993:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1789136095.283951:0:21993:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1789136095.283956:0:21993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789136095.283962:0:21993:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789136095.283966:0:21993:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff94a0806a3490) has no exports 00000020:00080000:1.0:1789136095.284067:0:21993:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff94a0806a3490) has no exports 00010000:00010000:2.0:1789136095.284274:0:17795:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789136095.284290:0:17795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.156@tcp lock: ffff949f4483c000/0xedd53ca6b6e46be4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xedd53ca6b6e46beb expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136095.284298:0:17795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff949f4483c000 already unused, calling callback (ffffffffc13c2c20) 10000000:00010000:2.0:1789136095.284301:0:17795:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.156@tcp lock: ffff949f4483c000/0xedd53ca6b6e46be4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xedd53ca6b6e46beb expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136095.284309:0:17795:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.156@tcp lock: ffff949f4483c000/0xedd53ca6b6e46be4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xedd53ca6b6e46beb expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789136095.284317:0:17795:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.156@tcp lock: ffff949f4483c000/0xedd53ca6b6e46be4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xedd53ca6b6e46beb expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789136095.284322:0:17795:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789136095.284325:0:17795:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:2.0:1789136095.284327:0:17795:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:2.0:1789136095.284340:0:17795:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff949f4486c800 00010000:00010000:2.0:1789136095.284344:0:17795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.156@tcp lock: ffff949f4483c000/0xedd53ca6b6e46be4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xedd53ca6b6e46beb expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136095.284350:0:17795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.156@tcp lock: ffff949f4483c000/0xedd53ca6b6e46be4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xedd53ca6b6e46beb expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136095.284413:0:17795:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789136095.284417:0:17795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.156@tcp lock: ffff949f43a18c00/0xedd53ca6b6e46dce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xedd53ca6b6e46dd5 expref: -99 pid: 17803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136095.284423:0:17795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff949f43a18c00 already unused, calling callback (ffffffffc13c2c20) 10000000:00010000:2.0:1789136095.284426:0:17795:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.156@tcp lock: ffff949f43a18c00/0xedd53ca6b6e46dce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xedd53ca6b6e46dd5 expref: -99 pid: 17803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136095.284453:0:17795:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.156@tcp lock: ffff949f43a18c00/0xedd53ca6b6e46dce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xedd53ca6b6e46dd5 expref: -99 pid: 17803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789136095.284459:0:17795:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.156@tcp lock: ffff949f43a18c00/0xedd53ca6b6e46dce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xedd53ca6b6e46dd5 expref: -99 pid: 17803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789136095.284464:0:17795:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789136095.284466:0:17795:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1789136095.284468:0:17795:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1789136095.284474:0:17795:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff949f4486c800 00010000:00010000:2.0:1789136095.284477:0:17795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.156@tcp lock: ffff949f43a18c00/0xedd53ca6b6e46dce lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xedd53ca6b6e46dd5 expref: -99 pid: 17803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136095.284483:0:17795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.156@tcp lock: ffff949f43a18c00/0xedd53ca6b6e46dce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xedd53ca6b6e46dd5 expref: -99 pid: 17803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136095.284496:0:17795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136095.284497:0:17795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136095.284499:0:17795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136095.288686:0:17796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1789136095.296013:0:21993:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff94a0435be1e0 - data ffff94a06fc875e8/ffff94a07f610800 00000020:01000000:1.0:1789136095.296371:0:21993:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff949f424ab840 - data ffff94a06fc2dbd0/ffff949f43625800 00100000:10000000:2.0:1789136095.309224:0:21993:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1789136095.318446:0:21993:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xedd53ca6b6e46bf9 00000020:00000080:3.0:1789136095.318460:0:21993:0:(genops.c:885:class_export_put()) final put ffff949f43790000/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1789136095.318471:0:21993:0:(tgt_mount.c:187:server_put_mount()) put mount ffff94a081859000 from lustre-OST0001, refs=2 00000020:01000004:3.0:1789136095.318475:0:21993:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94a081859000 2 00000020:01000004:3.0:1789136095.318479:0:21993:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff94a081859000 from lustre-OST0001 00000020:00000080:3.0:1789136095.318507:0:21993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789136095.318517:0:21993:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1789136095.318520:0:21993:0:(genops.c:885:class_export_put()) final put ffff949f43793800/lustre-OST0001_UUID 00000020:00000080:3.0:1789136095.318523:0:21993:0:(genops.c:844:class_export_destroy()) destroying export ffff949f43793800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1789136095.318528:0:21993:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1789136095.318611:0:21993:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 60cac2b7-c8b7-48ce-aa29-b6da8d73b5ee->MGS 00000020:00000080:0.0:1789136095.318678:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff949f43790000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00010000:00010000:3.0:1789136095.323091:0:21993:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.156@tcp lock: ffff94a043130400/0xedd53ca6b6e46944 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xedd53ca6b6e4694b expref: -99 pid: 18541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789136095.323114:0:21993:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.156@tcp lock: ffff94a043130400/0xedd53ca6b6e46944 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xedd53ca6b6e4694b expref: -99 pid: 18541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789136095.323120:0:21993:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1789136095.323124:0:21993:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1789136095.323127:0:21993:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1789136095.323143:0:21993:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff949f4486c800 00010000:00010000:3.0:1789136095.323152:0:21993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.156@tcp lock: ffff94a043130400/0xedd53ca6b6e46944 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xedd53ca6b6e4694b expref: -99 pid: 18541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136095.323191:0:21993:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.156@tcp lock: ffff94a076a5d200/0xedd53ca6b6e46833 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xedd53ca6b6e4683a expref: -99 pid: 17786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789136095.323198:0:21993:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.156@tcp lock: ffff94a076a5d200/0xedd53ca6b6e46833 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xedd53ca6b6e4683a expref: -99 pid: 17786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789136095.323216:0:21993:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789136095.323218:0:21993:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1789136095.323220:0:21993:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1789136095.323230:0:21993:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff949f4486c800 00010000:00010000:3.0:1789136095.323232:0:21993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.156@tcp lock: ffff94a076a5d200/0xedd53ca6b6e46833 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xedd53ca6b6e4683a expref: -99 pid: 17786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789136095.323249:0:21993:0:(import.c:65:import_set_state_nolock()) ffff949f4486c800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1789136095.323253:0:21993:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1789136095.323256:0:21993:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1789136095.323257:0:21993:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1789136095.323261:0:21993:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1789136095.324809:0:21993:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff94a07ad99e00 x1876044587189120/t0(0) o250->MGC192.168.206.156@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789136112 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1789136095.324842:0:21993:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1789136095.324846:0:21993:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 22s for inflight to error out 00000100:00100000:1.0:1789136095.324897:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07ad99e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:60cac2b7-c8b7-48ce-aa29-b6da8d73b5ee:3644:1876044587189120:0@lo:250:kworker.0 10000000:01000000:3.0:1789136095.324988:0:21993:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1789136095.324999:0:21993:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xedd53ca6b6e4681e 00000020:00000080:3.0:1789136095.325007:0:21993:0:(genops.c:885:class_export_put()) final put ffff949f44884000/60cac2b7-c8b7-48ce-aa29-b6da8d73b5ee 00000020:01000000:3.0:1789136095.325029:0:21993:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.206.156@tcp (flags='') 00000020:00000080:3.0:1789136095.325038:0:21993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789136095.325045:0:21993:0:(obd_config.c:956:class_cleanup()) MGC192.168.206.156@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789136095.325048:0:21993:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff949f42673490) has no exports 10000000:01000000:3.0:1789136095.325065:0:17803:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1789136095.325130:0:21993:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.206.156@tcp: client import never connected 00000100:00080000:3.0:1789136095.325134:0:21993:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1789136095.325136:0:21993:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1789136095.325138:0:21993:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1789136095.325140:0:21993:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1789136095.325171:0:21993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789136095.325177:0:21993:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.206.156@tcp (uuid 60cac2b7-c8b7-48ce-aa29-b6da8d73b5ee) 00000020:01000000:3.0:1789136095.325194:0:21993:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1789136095.325196:0:21993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789136095.325200:0:21993:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789136095.325205:0:21993:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff949f43769000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789136095.325210:0:21993:0:(genops.c:1553:class_disconnect_exports()) OBD device 27 (ffff949f44321a48) has exports, disconnecting them 00000020:00080000:3.0:1789136095.325215:0:21993:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff949f43769000), last request at 1789136020 00000020:00000080:3.0:1789136095.325219:0:21993:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xedd53ca6b6e46c23 00000020:00080000:3.0:1789136095.325230:0:21993:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff949f43769000): rc 0 00000020:00000080:3.0:1789136095.325234:0:21993:0:(genops.c:885:class_export_put()) final put ffff949f43769000/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1789136095.325948:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff949f44884000/60cac2b7-c8b7-48ce-aa29-b6da8d73b5ee for MGC192.168.206.156@tcp 00000020:00000080:1.0:1789136095.325965:0:479:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff949f4486c800 for MGC192.168.206.156@tcp 00000020:00000080:1.0:1789136095.325972:0:479:0:(genops.c:885:class_export_put()) final put ffff949f4486a000/60cac2b7-c8b7-48ce-aa29-b6da8d73b5ee 00000020:00000080:1.0:1789136095.325974:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff949f4486a000/60cac2b7-c8b7-48ce-aa29-b6da8d73b5ee for MGC192.168.206.156@tcp 00000020:01000000:1.0:1789136095.325980:0:479:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.206.156@tcp (60cac2b7-c8b7-48ce-aa29-b6da8d73b5ee) 00000020:00000080:1.0:1789136095.326258:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff949f43769000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1789136095.332182:0:21993:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1789136095.332190:0:21993:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789136095.332194:0:21993:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789136095.332201:0:21993:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789136095.332246:0:479:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff949f449c9800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1789136095.332448:0:21993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789136095.332455:0:21993:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1789136095.332461:0:21993:0:(genops.c:885:class_export_put()) final put ffff94a081820800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1789136095.332464:0:21993:0:(genops.c:844:class_export_destroy()) destroying export ffff94a081820800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1789136095.332470:0:21993:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:3.0:1789136095.332530:0:21993:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1789136095.332534:0:21993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789136095.332539:0:21993:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789136095.332546:0:21993:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff949f4286d800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789136095.332551:0:21993:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff949f4431ced8) has exports, disconnecting them 00000020:00080000:3.0:1789136095.332556:0:21993:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff949f4286d800), last request at 1789136020 00000020:00000080:3.0:1789136095.332559:0:21993:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xedd53ca6b6e46c38 00000020:00080000:3.0:1789136095.332572:0:21993:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff949f4286d800): rc 0 00000020:00000080:3.0:1789136095.332575:0:21993:0:(genops.c:885:class_export_put()) final put ffff949f4286d800/lustre-MDT0001-lwp-OST0001 00000020:00000080:1.0:1789136095.332658:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff949f4286d800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:0.0:1789136095.337728:0:21993:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:0.0:1789136095.337758:0:21993:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789136095.337762:0:21993:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789136095.337772:0:21993:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789136095.337836:0:21390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:1.0:1789136095.337977:0:479:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff949f4286a000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:1.0:1789136095.337998:0:17795:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1789136095.342323:0:17796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:0.0:1789136095.345105:0:17790:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff94a050ada800:17790] 0 exiting: rc = 1 00000100:00100000:2.0:1789136095.346330:0:17791:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff94a050adb200:17791] 1 exiting: rc = 0 00000100:00100000:0.0:1789136095.346542:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136095.347671:0:20957:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff949f43bbac00:20957] 3 exiting: rc = 0 00000100:00100000:2.0:1789136095.347751:0:17792:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff94a045625c00:17792] 0 exiting: rc = 1 00000100:00100000:0.0:1789136095.348550:0:17793:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff949f44800c00:17793] 1 exiting: rc = 0 00000100:00100000:0.0:1789136095.348670:0:17794:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff94a045624c00:17794] 2 exiting: rc = 0 00000100:00100000:0.0:1789136095.348730:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136095.348738:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136095.348744:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136095.348751:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136095.348769:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136095.348775:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136095.348780:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136095.348786:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136095.348790:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136095.348795:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136095.348800:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136095.348805:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136095.348811:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136095.348816:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136095.348821:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136095.348826:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136095.348832:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136095.348836:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136095.348841:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136095.348846:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136095.348852:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136095.349563:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136095.349572:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136095.349579:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136095.349586:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136095.349594:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136095.349617:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136095.349661:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136095.349669:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136095.349674:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136095.349679:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136095.349684:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136095.349690:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136095.349698:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136095.349703:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136095.349708:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136095.349713:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136095.349718:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136095.349723:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136095.349728:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136095.349733:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136095.349737:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136095.349743:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136095.349747:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136095.349753:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136095.349845:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136095.349851:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136095.349856:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136095.349861:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136095.349866:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136095.349871:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136095.349876:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136095.349880:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136095.349885:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136095.349890:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136095.349895:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136095.349900:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136095.350131:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136095.350141:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136095.350148:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136095.350153:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136095.350170:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136095.350188:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136095.350193:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1789136095.351395:0:21993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789136095.351406:0:21993:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:0.0:1789136095.351412:0:21993:0:(genops.c:885:class_export_put()) final put ffff949f4286e800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:0.0:1789136095.351416:0:21993:0:(genops.c:844:class_export_destroy()) destroying export ffff949f4286e800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:0.0:1789136095.351422:0:21993:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:0.0:1789136095.351532:0:21993:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94a081859000 1 00000020:00000080:0.0:1789136095.351539:0:21993:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xedd53ca6b6e46bdd 00000020:00000080:0.0:1789136095.351545:0:21993:0:(genops.c:885:class_export_put()) final put ffff949f4376d000/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1789136095.351561:0:21993:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1789136095.351566:0:21993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789136095.351571:0:21993:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789136095.351575:0:21993:0:(genops.c:1558:class_disconnect_exports()) OBD device 25 (ffff94a07ad31a48) has no exports 00000020:00000080:2.0:1789136095.351712:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff949f4376d000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1789136095.391184:0:21993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789136095.391204:0:21993:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1789136095.391210:0:21993:0:(genops.c:885:class_export_put()) final put ffff94a08185d800/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1789136095.391214:0:21993:0:(genops.c:844:class_export_destroy()) destroying export ffff94a08185d800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1789136095.391225:0:21993:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1789136095.391540:0:21993:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff94a08185a800 00000020:01000000:1.0:1789136095.391567:0:21993:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1789136095.391571:0:21993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789136095.391575:0:21993:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789136095.391579:0:21993:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff949f42671a48) has no exports 00000020:00000080:1.0:1789136095.391603:0:21993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789136095.391608:0:21993:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1789136095.391693:0:21993:0:(genops.c:885:class_export_put()) final put ffff94a052bf3800/OSS_uuid 00000020:00000080:1.0:1789136095.391696:0:21993:0:(genops.c:844:class_export_destroy()) destroying export ffff94a052bf3800/OSS_uuid for OSS 00000020:01000000:1.0:1789136095.391700:0:21993:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1789136095.391905:0:19318:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff94a07ac1e400:19318] 1 exiting: rc = 0 00000100:00100000:0.0:1789136095.391980:0:19846:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff949f43bbb600:19846] 3 exiting: rc = 0 00000100:00100000:2.0:1789136095.392144:0:19319:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff94a045624e00:19319] 2 exiting: rc = 0 00000100:00100000:2.0:1789136095.392209:0:19317:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff94a050299200:19317] 0 exiting: rc = 1 00000100:00080000:3.0:1789136095.392263:0:17802:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1789136095.392384:0:20956:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff949f42852a00:20956] 4 exiting: rc = 0 00000100:00100000:1.0:1789136095.392510:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.392518:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.392531:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.392536:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.392541:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.392548:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.392553:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.392559:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.392565:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.392594:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.392600:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.392604:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.393046:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.393059:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.393064:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.393070:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.393076:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.393082:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.393088:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.393093:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.393098:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.393104:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.393109:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.393115:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.393120:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.393126:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.393131:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.393136:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.393141:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.393146:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.393151:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.393157:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.393162:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.393167:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.393173:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.393178:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.393183:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.393196:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.393201:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.393207:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.393212:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.393217:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.393222:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.393227:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.393232:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.393237:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.393242:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.393248:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.393253:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.393258:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.393263:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.393269:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.393274:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.393279:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.393284:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.393289:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.393295:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.393300:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.393305:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.393311:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.393318:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.393323:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.393328:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.393333:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136095.394499:0:19320:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff94a07a2b4800:19320] 0 exiting: rc = 1 00000100:00100000:2.0:1789136095.394600:0:19321:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff94a07a2b5400:19321] 1 exiting: rc = 0 00000100:00100000:1.0:1789136095.394955:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.394970:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.394976:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.394983:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.394989:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.394994:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.394999:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.395004:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.395021:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.395026:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.395031:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.395036:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.395041:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.395046:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.395051:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.395056:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.395061:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.395067:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.395072:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.395078:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.395083:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.395089:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.395094:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.395098:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.395103:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.395107:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.395112:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.395116:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.395120:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.395125:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.395131:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.395136:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.395141:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.395146:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.395153:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.395158:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.395164:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.395169:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.395175:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.395181:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.395187:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.395193:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.395198:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.395211:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.395216:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.395222:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.395227:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.395232:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.395240:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.395245:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.395251:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.395256:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.395261:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.395266:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.395271:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.395276:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.395281:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.395285:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.395290:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.395295:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.395300:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.395305:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.395310:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.395316:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136095.397056:0:19324:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff94a07a058200:19324] 2 exiting: rc = 0 00000100:00100000:2.0:1789136095.397555:0:19322:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff94a07a059c00:19322] 0 exiting: rc = 1 00000100:00100000:3.0:1789136095.397885:0:19323:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff94a07a058a00:19323] 1 exiting: rc = 0 00000100:00100000:1.0:1789136095.398006:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.398022:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.398035:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.398041:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.398048:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.398056:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.398064:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.398071:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.398077:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.398084:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.398092:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.398100:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.398111:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.398117:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.398145:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.398152:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.398157:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.398168:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.398191:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.398200:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.398206:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.398212:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.398218:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.398224:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.398229:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.398235:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.398240:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.398245:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.398250:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.398255:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.398261:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.398266:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.398272:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.398278:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.398283:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.398288:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.398293:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.398298:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.398303:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.398309:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.398315:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.398320:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.398341:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.398347:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.398353:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.398358:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.398363:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.398369:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.398374:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.398387:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.398393:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.398399:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.398405:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.398410:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.398416:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.398422:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.398428:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.398433:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.398448:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.398455:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.398461:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.398474:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.398488:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.398501:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136095.402585:0:19325:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff94a07a058c00:19325] 0 exiting: rc = 1 00000100:00100000:0.0:1789136095.402716:0:19326:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff94a07a059400:19326] 1 exiting: rc = 0 00000100:00100000:1.0:1789136095.402898:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.402912:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.402919:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.402924:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.402929:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.402935:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.402940:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.402945:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.402950:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.402955:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.402959:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.402964:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.402968:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.402973:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.402977:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.402982:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.402987:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.402992:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.402997:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.403001:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.403017:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.403022:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.403027:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.403032:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.403037:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.403041:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.403046:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.403050:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.403055:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.403059:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.403064:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.403069:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.403074:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.403078:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.403095:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.403100:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.403105:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.403110:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.403114:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.403119:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.403123:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.403128:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.403132:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.403137:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.403142:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.403146:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.403151:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.403156:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.403161:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.403166:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.403171:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.403176:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.403181:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.403185:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.403190:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.403198:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.403203:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.403207:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.403212:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.403217:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.403222:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.403226:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.403231:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.403236:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136095.404806:0:19327:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff94a07a059600:19327] 0 exiting: rc = 1 00000100:00100000:3.0:1789136095.405044:0:19328:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff94a07a059000:19328] 1 exiting: rc = 0 00000100:00100000:1.0:1789136095.405447:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.405470:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.405479:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.405485:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.405490:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.405497:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.405520:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.405527:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.405532:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.405538:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.405543:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.405549:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.405555:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.405561:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.405566:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.405572:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.405578:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.405584:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.405604:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.405617:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.405623:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.405892:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.405898:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.405905:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.405912:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.405918:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.405938:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.405944:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.405950:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.405958:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.405979:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.405986:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.405992:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.405997:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.406003:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.406008:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.406014:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.406020:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.406027:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.406033:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.406040:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.406047:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.406069:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.406077:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.406082:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.406088:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.406093:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.406099:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.406105:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.406110:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.406116:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.406121:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.406126:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.406132:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.406151:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.406158:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.406163:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.406169:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.406174:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.406179:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.406183:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.406196:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.406201:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136095.406213:0:21993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1789136095.414208:0:21993:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1789136115.205775:0:22758:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg656-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1789136126.115339:0:23357:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789136126.115345:0:23357:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1789136126.115347:0:23357:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1789136126.116334:0:23357:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff949f449ce800 00000020:01000004:2.0:1789136126.116352:0:23357:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1789136126.116360:0:23357:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789136126.116374:0:23357:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff94a07ad31a48) 00000020:00000080:2.0:1789136126.116386:0:23357:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789136126.218770:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1789136126.220744:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1789136126.224256:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1789136126.230019:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1789136126.230585:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1789136126.230996:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1789136126.231553:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1789136126.231862:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1789136126.232154:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1789136126.234128:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1789136126.234743:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1789136126.235055:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1789136126.235268:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1789136126.239233:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1789136126.239767:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1789136126.240351:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1789136126.240712:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1789136126.240920:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1789136126.241126:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1789136126.241400:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1789136126.244678:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1789136126.245054:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1789136126.245575:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1789136126.245939:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1789136126.246207:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1789136126.248043:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1789136126.248909:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1789136126.249206:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1789136126.249595:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1789136126.249926:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1789136126.250211:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1789136126.250619:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1789136126.251017:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1789136126.253819:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1789136126.254269:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1789136126.259739:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1789136126.261266:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1789136126.262112:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1789136126.263257:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1789136126.263572:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1789136126.263858:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1789136126.264236:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1789136126.264541:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1789136126.264806:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1789136126.265143:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1789136126.265452:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1789136126.265787:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1789136126.266529:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1789136126.267615:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1789136126.268396:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1789136126.269299:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1789136126.269535:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1789136126.269785:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:01000000:2.0:1789136126.271935:0:23357:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789136126.272372:0:23357:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1789136126.272380:0:23357:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789136126.272392:0:23357:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xedd53ca6b6e4708a 00000020:01000004:3.0:1789136126.272399:0:23357:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1789136126.272404:0:23357:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1789136126.272409:0:23357:0:(tgt_mount.c:101:server_register_mount()) register mount ffff949f449ce800 from MGS 00000020:01000004:3.0:1789136126.272413:0:23357:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1789136126.272424:0:23357:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff949f44321a48) 00000020:00000080:3.0:1789136126.272433:0:23357:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1789136126.272503:0:23357:0:(tgt_mount.c:153:server_get_mount()) get mount ffff949f449ce800 from MGS, refs=2 00080000:01000000:3.0:1789136126.272521:0:23357:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789136126.272526:0:23357:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xedd53ca6b6e47098 00000100:00100000:3.0:1789136126.272613:0:23357:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1789136126.272828:0:23357:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1789136126.272834:0:23357:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1789136126.273412:0:23357:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1789136126.273419:0:23357:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1789136126.274256:0:23357:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789136126.274398:0:23357:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1789136126.274403:0:23357:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1789136126.274875:0:23357:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1789136126.274881:0:23357:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1789136126.275602:0:23357:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1789136126.275611:0:23357:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1789136126.276416:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136126.276420:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136126.276422:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136126.276801:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136126.276804:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136126.276806:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136126.277318:0:23357:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1789136126.279853:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1789136126.287928:0:23357:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1789136126.288726:0:23369:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1789136126.289109:0:23357:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1789136126.289218:0:23357:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789136126.289946:0:23357:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1789136126.291350:0:23357:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789136126.291538:0:23357:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1789136126.291545:0:23357:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1789136126.292361:0:23357:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1789136126.292370:0:23357:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1789136126.294260:0:23357:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1789136126.294272:0:23357:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1789136126.295156:0:23357:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1789136126.295179:0:23357:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.156@tcp' 00000020:01000004:3.0:1789136126.295181:0:23357:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1789136126.295210:0:23357:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.156@tcp (typ=mgc) 00000020:00000080:3.0:1789136126.295222:0:23357:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.156@tcp (ffff949f44320000) 00000020:00000080:3.0:1789136126.295238:0:23357:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1789136126.295367:0:23357:0:(ldlm_lib.c:102:import_set_conn()) imp ffff949f42662000@MGC192.168.206.156@tcp: add connection 192.168.206.156@tcp at head 00010000:00010000:3.0:1789136126.295527:0:23357:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.156@tcp-0 is initialized 00000040:01000000:3.0:1789136126.295533:0:23357:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.156@tcp ctxt 1 is initialized 10000000:01000000:0.0:1789136126.298943:0:23375:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1789136126.299120:0:23357:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.156@tcp (uuid 3644072c-bb98-4fbe-9eaf-e40d57d161d0) 00000020:00000080:1.0:1789136126.299142:0:23357:0:(genops.c:1385:class_connect()) connect: client 3644072c-bb98-4fbe-9eaf-e40d57d161d0, cookie 0xedd53ca6b6e470a6 00000100:00080000:1.0:1789136126.299153:0:23357:0:(import.c:510:import_select_connection()) MGC192.168.206.156@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789136126.299170:0:23357:0:(import.c:624:import_select_connection()) MGC192.168.206.156@tcp: import ffff949f42662000 using connection 192.168.206.156@tcp/0@lo 00000100:00100000:1.0:1789136126.299200:0:23357:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff949f4416cf00 x1876044587189248/t0(0) o250->MGC192.168.206.156@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789136126.299229:0:23357:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 3644072c-bb98-4fbe-9eaf-e40d57d161d0->MGS 00000020:01000004:1.0:1789136126.299248:0:23357:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1789136126.299267:0:23357:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1789136126.299281:0:23357:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff949f4431b490) 00000020:00000080:1.0:1789136126.299293:0:23357:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1789136126.300108:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4416cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3644072c-bb98-4fbe-9eaf-e40d57d161d0:3644:1876044587189248:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1789136126.300172:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136126.300243:0:23371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587189248 00000100:00100000:0.0:1789136126.300250:0:23371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587189248 00000100:00100000:0.0:1789136126.300295:0:23371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789136126.300303:0:23371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a08199a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3644:x1876044587189248:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1789136126.300325:0:23371:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 3644072c-bb98-4fbe-9eaf-e40d57d161d0@0@lo t0 exp 0000000000000000 cur 664 last 0 00000020:00000080:0.0:1789136126.300354:0:23371:0:(genops.c:1385:class_connect()) connect: client 3644072c-bb98-4fbe-9eaf-e40d57d161d0, cookie 0xedd53ca6b6e470b4 00000100:00080000:0.0:1789136126.300468:0:23371:0:(import.c:65:import_set_state_nolock()) ffff94a07f63e800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789136126.300529:0:23371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a08199a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+5:3644:x1876044587189248:12345-0@lo:250:mount.lustre.0 Request processed in 226us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136126.300536:0:23371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789136126.300567:0:3644:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.206.156@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1789136126.300575:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.206.156@tcp: connect to target with instance 0 00000100:00080000:0.0:1789136126.300582:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.206.156@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1789136126.300586:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1789136126.300589:0:3644:0:(import.c:65:import_set_state_nolock()) ffff949f42662000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1789136126.300591:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1789136126.300598:0:3644:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1789136126.300603:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4416cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3644072c-bb98-4fbe-9eaf-e40d57d161d0:3644:1876044587189248:0@lo:250:mount.lustre.0 00000100:00080000:0.0:1789136126.303889:0:23374:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:1.0:1789136126.323399:0:23357:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789136126.323907:0:23357:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1789136126.323914:0:23357:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1789136126.325300:0:23357:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1789136126.325311:0:23357:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1789136126.326211:0:23357:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1789136126.326221:0:23357:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1789136126.327617:0:23357:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789136126.328147:0:23357:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1789136126.328154:0:23357:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1789136126.329185:0:23357:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1789136126.329195:0:23357:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1789136126.377334:0:23357:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789136126.377612:0:23357:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1789136126.377618:0:23357:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1789136126.379323:0:23357:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1789136126.379336:0:23357:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1789136126.380359:0:23357:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789136126.380608:0:23357:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789136126.380614:0:23357:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1789136126.381467:0:23357:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789136126.381554:0:23357:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1789136126.382378:0:23357:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789136126.382874:0:23357:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789136126.382883:0:23357:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1789136126.383873:0:23357:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789136126.383882:0:23357:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1789136126.385076:0:23357:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789136126.385318:0:23357:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789136126.385325:0:23357:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1789136126.386384:0:23357:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789136126.386394:0:23357:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1789136126.407559:0:23357:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789136126.408166:0:23357:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789136126.408173:0:23357:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1789136126.411106:0:23357:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789136126.411120:0:23357:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1789136126.413448:0:23357:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789136126.413463:0:23357:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1789136126.417373:0:23357:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1789136126.417405:0:23357:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1789136126.417411:0:23357:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.156@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1789136126.417599:0:23357:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.156@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789136126.418236:0:23357:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.156@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1789136126.418242:0:23357:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789136126.418243:0:23357:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789136126.418245:0:23357:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789136126.418246:0:23357:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789136126.418247:0:23357:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789136126.418248:0:23357:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789136126.418250:0:23357:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789136126.418251:0:23357:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789136126.418253:0:23357:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789136126.418254:0:23357:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789136126.418257:0:23357:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1789136126.418259:0:23357:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789136126.418260:0:23357:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789136126.418262:0:23357:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789136126.418263:0:23357:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789136126.418264:0:23357:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789136126.418265:0:23357:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789136126.418266:0:23357:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789136126.418267:0:23357:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789136126.418268:0:23357:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789136126.418269:0:23357:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789136126.418305:0:23357:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789136126.418325:0:23357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a06f1a6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23357:1876044587189376:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789136126.418391:0:23357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136126.418438:0:23357:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a045639a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789136126.418579:0:23373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587189376 00000100:00100000:0.0:1789136126.418586:0:23373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587189376 00000100:00100000:0.0:1789136126.418658:0:23373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789136126.418668:0:23373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a081999850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3644072c-bb98-4fbe-9eaf-e40d57d161d0+5:23357:x1876044587189376:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789136126.418726:0:23373:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789136126.418735:0:23373:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789136126.418738:0:23373:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1789136126.419616:0:23394:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1789136126.421370:0:23373:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:2.0:1789136126.431769:0:23395:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1789136126.431777:0:23395:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1789136126.431780:0:23395:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1789136126.431784:0:23395:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1789136126.432446:0:23395:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1789136126.432863:0:23373:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789136126.432874:0:23373:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1789136126.440644:0:23373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a081999850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3644072c-bb98-4fbe-9eaf-e40d57d161d0+5:23357:x1876044587189376:12345-0@lo:253:mount.lustre.0 Request processed in 21956us (22231us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136126.440663:0:23373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789136126.442094:0:23357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a06f1a6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23357:1876044587189376:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789136126.442113:0:23357:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789136126.442116:0:23357:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789136126.442117:0:23357:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789136126.442118:0:23357:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789136126.442119:0:23357:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789136126.442120:0:23357:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789136126.442122:0:23357:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789136126.442123:0:23357:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789136126.442124:0:23357:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789136126.442126:0:23357:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789136126.442127:0:23357:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789136126.442150:0:23357:0:(tgt_mount.c:101:server_register_mount()) register mount ffff949f449ce800 from lustre-MDT0000 10000000:01000000:2.0:1789136126.442181:0:23357:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1789136126.442184:0:23357:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1789136126.442188:0:23357:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff949f44320000 10000000:01000000:2.0:1789136126.442193:0:23357:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789136126.442200:0:23357:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff949f44320000 from 1 10000000:01000000:2.0:1789136126.442203:0:23357:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789136126.442242:0:23357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a0429a9600/0xedd53ca6b6e470bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136126.442251:0:23357:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.156@tcp lock: ffff94a0429a9600/0xedd53ca6b6e470bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136126.442260:0:23357:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.156@tcp lock: ffff94a0429a9600/0xedd53ca6b6e470bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136126.442277:0:23357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a06f1a6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23357:1876044587189504:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789136126.442346:0:23357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136126.442928:0:23357:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a0456399c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789136126.442938:0:23371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587189504 00000100:00100000:0.0:1789136126.442948:0:23371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587189504 00000100:00100000:0.0:1789136126.443008:0:23371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789136126.443018:0:23371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a08199bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+5:23357:x1876044587189504:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789136126.443031:0:23371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136126.443046:0:23371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94a0413fde00/0xedd53ca6b6e470c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xedd53ca6b6e470bb expref: -99 pid: 23371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136126.443152:0:23371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94a0413fde00/0xedd53ca6b6e470c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedd53ca6b6e470bb expref: 6 pid: 23371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136126.443164:0:23371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94a0413fde00/0xedd53ca6b6e470c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedd53ca6b6e470bb expref: 6 pid: 23371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136126.443173:0:23371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94a0413fde00, rc 0) 00000100:00100000:1.0:1789136126.443223:0:23371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a08199bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+6:23357:x1876044587189504:12345-0@lo:101:mount.lustre.0 Request processed in 208us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136126.443230:0:23371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789136126.443381:0:23357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a06f1a6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23357:1876044587189504:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789136126.443395:0:23357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.156@tcp lock: ffff94a0429a9600/0xedd53ca6b6e470bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e470c2 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136126.443405:0:23357:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.156@tcp lock: ffff94a0429a9600/0xedd53ca6b6e470bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xedd53ca6b6e470c2 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136126.443465:0:23357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a06f1a6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23357:1876044587189632:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789136126.443610:0:23357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136126.443665:0:23357:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a0456399c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789136126.443831:0:23373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587189632 00000100:00100000:3.0:1789136126.443836:0:23373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587189632 00000100:00100000:3.0:1789136126.443873:0:23373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789136126.443880:0:23373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a081999450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3644072c-bb98-4fbe-9eaf-e40d57d161d0+6:23357:x1876044587189632:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789136126.443970:0:23373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a081999450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3644072c-bb98-4fbe-9eaf-e40d57d161d0+6:23357:x1876044587189632:12345-0@lo:501:mount.lustre.0 Request processed in 89us (359us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789136126.443977:0:23373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789136126.444103:0:23357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a06f1a6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23357:1876044587189632:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789136126.444130:0:23357:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.156@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789136126.444152:0:23357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a0429a9600/0xedd53ca6b6e470bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e470c2 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136126.444160:0:23357:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.156@tcp lock: ffff94a0429a9600/0xedd53ca6b6e470bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e470c2 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789136126.444168:0:23357:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff949f449ce800 10000000:01000000:2.0:1789136126.444173:0:23357:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789136126.444176:0:23357:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff949f449ce800 10000000:01000000:2.0:1789136126.444179:0:23357:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1789136126.444181:0:23357:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff949f449ce800 from 1 10000000:01000000:2.0:1789136126.444184:0:23357:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1789136126.444203:0:23357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a0429a9400/0xedd53ca6b6e470c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136126.444222:0:23357:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.156@tcp lock: ffff94a0429a9400/0xedd53ca6b6e470c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136126.444230:0:23357:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.156@tcp lock: ffff94a0429a9400/0xedd53ca6b6e470c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136126.444243:0:23357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a06f1a6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23357:1876044587189760:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789136126.444270:0:23357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136126.444293:0:23357:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a0456399c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789136126.444439:0:23371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587189760 00000100:00100000:3.0:1789136126.444444:0:23371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587189760 00000100:00100000:3.0:1789136126.444489:0:23371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789136126.444497:0:23371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a08199a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+6:23357:x1876044587189760:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789136126.444505:0:23371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789136126.444517:0:23371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff949f4483d000/0xedd53ca6b6e470d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xedd53ca6b6e470c9 expref: -99 pid: 23371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136126.444535:0:23371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff949f4483d000/0xedd53ca6b6e470d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedd53ca6b6e470c9 expref: 7 pid: 23371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136126.444544:0:23371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff949f4483d000/0xedd53ca6b6e470d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedd53ca6b6e470c9 expref: 7 pid: 23371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136126.444551:0:23371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff949f4483d000, rc 0) 00000100:00100000:3.0:1789136126.444579:0:23371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a08199a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+7:23357:x1876044587189760:12345-0@lo:101:mount.lustre.0 Request processed in 84us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136126.444597:0:23371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789136126.444815:0:23357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a06f1a6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23357:1876044587189760:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789136126.444825:0:23357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.156@tcp lock: ffff94a0429a9400/0xedd53ca6b6e470c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e470d0 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136126.444834:0:23357:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.156@tcp lock: ffff94a0429a9400/0xedd53ca6b6e470c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xedd53ca6b6e470d0 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789136126.444844:0:23357:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.156@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1789136126.444914:0:23357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a0429a9400/0xedd53ca6b6e470c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e470d0 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136126.444923:0:23357:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.156@tcp lock: ffff94a0429a9400/0xedd53ca6b6e470c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e470d0 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789136126.444930:0:23357:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1789136126.444934:0:23357:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789136126.444939:0:23357:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff949f449ce800 10000000:01000000:2.0:1789136126.444943:0:23357:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1789136126.444954:0:23357:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1789136126.444957:0:23357:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789136126.444972:0:23357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a0429a9c00/0xedd53ca6b6e470d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136126.444980:0:23357:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.156@tcp lock: ffff94a0429a9c00/0xedd53ca6b6e470d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136126.444986:0:23357:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.156@tcp lock: ffff94a0429a9c00/0xedd53ca6b6e470d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136126.445000:0:23357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a06f1a6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23357:1876044587189888:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789136126.445029:0:23357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136126.445057:0:23357:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a0456399c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789136126.445229:0:23371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587189888 00000100:00100000:3.0:1789136126.445235:0:23371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587189888 00000100:00100000:3.0:1789136126.445266:0:23371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789136126.445273:0:23371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a08199b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+7:23357:x1876044587189888:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789136126.445286:0:23371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789136126.445295:0:23371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff949f4483c200/0xedd53ca6b6e470de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xedd53ca6b6e470d7 expref: -99 pid: 23371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136126.445310:0:23371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff949f4483c200/0xedd53ca6b6e470de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedd53ca6b6e470d7 expref: 8 pid: 23371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136126.445318:0:23371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff949f4483c200/0xedd53ca6b6e470de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedd53ca6b6e470d7 expref: 8 pid: 23371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136126.445325:0:23371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff949f4483c200, rc 0) 00000100:00100000:3.0:1789136126.445372:0:23371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a08199b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+8:23357:x1876044587189888:12345-0@lo:101:mount.lustre.0 Request processed in 99us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136126.445379:0:23371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789136126.445565:0:23357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a06f1a6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23357:1876044587189888:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789136126.445577:0:23357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.156@tcp lock: ffff94a0429a9c00/0xedd53ca6b6e470d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e470de expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136126.445584:0:23357:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.156@tcp lock: ffff94a0429a9c00/0xedd53ca6b6e470d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xedd53ca6b6e470de expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136126.445668:0:23357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a06f1a6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23357:1876044587190016:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789136126.445697:0:23357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136126.445725:0:23357:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a0456399c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789136126.445829:0:23373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587190016 00000100:00100000:3.0:1789136126.445833:0:23373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587190016 00000100:00100000:3.0:1789136126.445864:0:23373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789136126.445870:0:23373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a08199b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3644072c-bb98-4fbe-9eaf-e40d57d161d0+8:23357:x1876044587190016:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789136126.446005:0:23373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a08199b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3644072c-bb98-4fbe-9eaf-e40d57d161d0+9:23357:x1876044587190016:12345-0@lo:501:mount.lustre.0 Request processed in 135us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136126.446013:0:23373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789136126.446136:0:23357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a06f1a6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23357:1876044587190016:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789136126.446167:0:23357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a06f1a6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23357:1876044587190144:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789136126.446206:0:23357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136126.446234:0:23357:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a0456399c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789136126.446282:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587190144 00000100:00100000:0.0:1789136126.446287:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587190144 00000100:00100000:0.0:1789136126.446321:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789136126.446328:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a081998050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+9:23357:x1876044587190144:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789136126.447244:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a081998050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+9:23357:x1876044587190144:12345-0@lo:503:mount.lustre.0 Request processed in 913us (1034us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136126.447252:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789136126.448371:0:23357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a06f1a6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23357:1876044587190144:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789136126.451270:0:23396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a0556dfc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23396:1876044587190272:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789136126.451373:0:23396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136126.451419:0:23396:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a0516a1900 going to sleep for 11 seconds 00000100:00100000:0.0:1789136126.452119:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587190272 00000100:00100000:0.0:1789136126.452126:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587190272 00000100:00100000:0.0:1789136126.452177:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789136126.452186:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a076bd1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+9:23396:x1876044587190272:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789136126.453195:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a076bd1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+9:23396:x1876044587190272:12345-0@lo:502:llog_process_th.0 Request processed in 1007us (1819us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136126.453206:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789136126.453308:0:23396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a0556dfc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23396:1876044587190272:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789136126.453342:0:23396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789136126.453421:0:23396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136126.453431:0:23396:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789136126.453438:0:23396:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1789136126.453441:0:23396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789136126.453455:0:23396:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff949f44324ed8) 00000020:00000080:3.0:1789136126.453543:0:23396:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1789136126.453550:0:23396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1789136126.453787:0:23396:0:(osd_handler.c:8895:osd_obd_connect()) connect #2 00000020:00000080:3.0:1789136126.453795:0:23396:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xedd53ca6b6e470ec 00000020:00000080:3.0:1789136126.453992:0:23396:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1789136126.453998:0:23396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789136126.454002:0:23396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136126.454003:0:23396:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789136126.454006:0:23396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789136126.454010:0:23396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136126.454011:0:23396:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1789136126.454014:0:23396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789136126.454021:0:23396:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff949f44323490) 00000020:00000080:3.0:1789136126.454030:0:23396:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1789136126.454033:0:23396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789136126.454035:0:23396:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1789136126.454038:0:23396:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1789136126.454043:0:23396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789136126.454097:0:23396:0:(tgt_mount.c:153:server_get_mount()) get mount ffff949f449ce800 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1789136126.454112:0:23396:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff94a07549ced8) 00000020:00000080:3.0:1789136126.454121:0:23396:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1789136126.454166:0:23396:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:3.0:1789136126.454171:0:23396:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xedd53ca6b6e47101 00000020:00000080:3.0:1789136126.454260:0:23396:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1789136126.454266:0:23396:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789136126.454270:0:23396:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xedd53ca6b6e47108 00080000:01000000:3.0:1789136126.454275:0:23396:0:(osd_handler.c:8895:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789136126.454278:0:23396:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xedd53ca6b6e4710f 00010000:00010000:1.0:1789136126.563559:0:23396:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1789136126.564718:0:23396:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934628 00000001:00080000:1.0:1789136126.565091:0:23396:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1789136126.565720:0:23396:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff949f44319a48) 00000020:00000080:1.0:1789136126.565739:0:23396:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1789136126.565826:0:23396:0:(osd_handler.c:8895:osd_obd_connect()) connect #4 00000020:00000080:1.0:1789136126.565833:0:23396:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xedd53ca6b6e4711d 00000020:00000080:0.0:1789136126.566321:0:23396:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1789136126.574061:0:23396:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xedd53ca6b6e47124 00000020:00000080:0.0:1789136126.577028:0:23396:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1789136126.577058:0:23396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789136126.577237:0:23396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136126.577245:0:23396:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1789136126.577251:0:23396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789136126.577254:0:23396:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1789136126.577261:0:23396:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789136126.577262:0:23396:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789136126.577264:0:23396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789136126.577267:0:23396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136126.577268:0:23396:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789136126.577271:0:23396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789136126.577277:0:23396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136126.577278:0:23396:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1789136126.577282:0:23396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1789136126.577333:0:23396:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1789136126.577349:0:23396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789136126.577362:0:23396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136126.577365:0:23396:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1789136126.577368:0:23396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789136126.577371:0:23396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136126.577372:0:23396:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1789136126.577375:0:23396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789136126.577380:0:23396:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.156@tcp to nid 0x20000c0a8ce9c (192.168.206.156@tcp) 00000020:00000080:1.0:1789136126.577410:0:23396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789136126.577425:0:23396:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff949f4431ced8) 00000020:00000080:1.0:1789136126.577441:0:23396:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1789136126.577446:0:23396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789136126.577517:0:23396:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1789136126.577523:0:23396:0:(osd_handler.c:8895:osd_obd_connect()) connect #5 00000020:00000080:1.0:1789136126.577530:0:23396:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xedd53ca6b6e47132 00010000:00080000:1.0:1789136126.577559:0:23396:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94a076549800@lustre-MDT0001-osp-MDT0000: add connection 192.168.206.156@tcp at head 00010000:00010000:1.0:1789136126.579187:0:23396:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:1.0:1789136126.580406:0:23396:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789136126.580420:0:23396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1789136126.580448:0:23396:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789136126.580467:0:23396:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xedd53ca6b6e47139 00000100:00080000:1.0:1789136126.580488:0:23396:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789136126.580494:0:23396:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff94a076549800 using connection 192.168.206.156@tcp/0@lo 00000100:00100000:1.0:1789136126.580534:0:23396:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff949f4416c000 x1876044587190400/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789136126.580562:0:23396:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1789136126.580674:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4416c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876044587190400:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789136126.580770:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:1.0:1789136126.580908:0:23396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789136126.580912:0:23396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136126.580914:0:23396:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1789136126.580917:0:23396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789136126.580919:0:23396:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:1.0:1789136126.580920:0:23396:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789136126.580922:0:23396:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789136126.580923:0:23396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789136126.580925:0:23396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136126.580926:0:23396:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789136126.580928:0:23396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789136126.580932:0:23396:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1789136126.580935:0:23396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136126.580937:0:23396:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789136126.580940:0:23396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789136126.580943:0:23396:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.156@tcp to nid 0x20000c0a8ce9c (192.168.206.156@tcp) 00000020:01000000:1.0:1789136126.580964:0:23396:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789136126.580966:0:23396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789136126.580979:0:23396:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff949f44318000) 00000020:00000080:1.0:1789136126.580991:0:23396:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1789136126.580996:0:23396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789136126.581049:0:23396:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1789136126.581056:0:23396:0:(osd_handler.c:8895:osd_obd_connect()) connect #6 00000020:00000080:1.0:1789136126.581061:0:23396:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xedd53ca6b6e47147 00010000:00080000:1.0:1789136126.581097:0:23396:0:(ldlm_lib.c:102:import_set_conn()) imp ffff949f443e6000@lustre-OST0000-osc-MDT0000: add connection 192.168.206.156@tcp at head 00010000:00010000:1.0:1789136126.581289:0:23396:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:3.0:1789136126.581805:0:23383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587190400 00000100:00100000:3.0:1789136126.581818:0:23383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587190400 00000100:00100000:3.0:1789136126.581857:0:23383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789136126.581864:0:23383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a07ad99680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1876044587190400:12345-0@lo:38:llog_process_th.0 00010000:00020000:3.0:1789136126.581878:0:23383:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:1.0:1789136126.585170:0:23396:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789136126.585446:0:23396:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789136126.586968:0:23396:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789136126.587176:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:1.0:1789136126.587326:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:1.0:1789136126.595377:0:23402:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1789136126.595384:0:23402:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1789136126.598570:0:23396:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789136126.598585:0:23396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789136126.598651:0:23396:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789136126.598670:0:23396:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xedd53ca6b6e4714e 00000100:00080000:1.0:1789136126.598680:0:23396:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789136126.598686:0:23396:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff949f443e6000 using connection 192.168.206.156@tcp/0@lo 00000100:00100000:1.0:1789136126.598719:0:23396:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff949f4416f840 x1876044587190528/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789136126.598741:0:23396:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1789136126.598807:0:23396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789136126.598811:0:23396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136126.598813:0:23396:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1789136126.598816:0:23396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789136126.598818:0:23396:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:1.0:1789136126.598820:0:23396:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789136126.598821:0:23396:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789136126.598822:0:23396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789136126.598825:0:23396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136126.598826:0:23396:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789136126.598829:0:23396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789136126.598832:0:23396:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1789136126.598836:0:23396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136126.598837:0:23396:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1789136126.598840:0:23396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789136126.598844:0:23396:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.156@tcp to nid 0x20000c0a8ce9c (192.168.206.156@tcp) 00000020:01000000:1.0:1789136126.598866:0:23396:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789136126.598881:0:23396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789136126.598892:0:23396:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff94a043761a48) 00000020:00000080:1.0:1789136126.598903:0:23396:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:1.0:1789136126.598908:0:23396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789136126.598971:0:23396:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1789136126.598977:0:23396:0:(osd_handler.c:8895:osd_obd_connect()) connect #7 00000020:00000080:1.0:1789136126.598982:0:23396:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xedd53ca6b6e4715c 00010000:00080000:1.0:1789136126.599008:0:23396:0:(ldlm_lib.c:102:import_set_conn()) imp ffff949f443e6800@lustre-OST0001-osc-MDT0000: add connection 192.168.206.156@tcp at head 00010000:00010000:1.0:1789136126.599240:0:23396:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1789136126.599305:0:23396:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789136126.599320:0:23396:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:0.0:1789136126.599522:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4416f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876044587190528:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789136126.599569:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876044587190528 offset 0 length 520: 4 00000100:00100000:2.0:1789136126.601084:0:23383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a07ad99680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1876044587190400:12345-0@lo:38:llog_process_th.0 Request processed in 19214us (20308us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789136126.601100:0:23383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1789136126.601180:0:3644:0:(import.c:65:import_set_state_nolock()) ffff94a076549800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789136126.601185:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789136126.601189:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4416c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876044587190400:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1789136126.601844:0:23396:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789136126.602144:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:1.0:1789136126.602243:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:1.0:1789136126.605814:0:23404:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1789136126.605821:0:23404:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1789136126.606383:0:23396:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789136126.606397:0:23396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789136126.606431:0:23396:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789136126.606451:0:23396:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xedd53ca6b6e47163 00000100:00080000:2.0:1789136126.606461:0:23396:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789136126.606545:0:23396:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff949f443e6800 using connection 192.168.206.156@tcp/0@lo 00000100:00100000:2.0:1789136126.606579:0:23396:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94a06f1a6940 x1876044587190656/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789136126.606658:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a06f1a6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876044587190656:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1789136126.606720:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876044587190656 offset 0 length 520: 4 00000100:00080000:2.0:1789136126.606841:0:23396:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1789136126.606903:0:23396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789136126.606907:0:23396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789136126.606909:0:23396:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1789136126.606912:0:23396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789136126.606917:0:23396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789136126.606918:0:23396:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789136126.606920:0:23396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789136126.606922:0:23396:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789136126.606924:0:23396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789136126.606926:0:23396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789136126.606927:0:23396:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789136126.606929:0:23396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789136126.606931:0:23396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789136126.606933:0:23396:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789136126.606936:0:23396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789136126.606961:0:23396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a06f1a5680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23396:1876044587190784:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789136126.607014:0:23396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136126.607042:0:23396:0:(client.c:2715:ptlrpc_set_wait()) set ffff949f428fae40 going to sleep for 11 seconds 00000100:00100000:3.0:1789136126.607213:0:23371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587190784 00000100:00100000:3.0:1789136126.607220:0:23371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587190784 00000100:00100000:3.0:1789136126.607255:0:23371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789136126.607264:0:23371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a076bd3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+9:23396:x1876044587190784:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789136126.607378:0:23371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a076bd3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+9:23396:x1876044587190784:12345-0@lo:502:llog_process_th.0 Request processed in 115us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136126.607386:0:23371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789136126.607491:0:23396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a06f1a5680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23396:1876044587190784:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789136126.607514:0:23396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789136126.607518:0:23396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136126.607520:0:23396:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789136126.607524:0:23396:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1789136126.607583:0:23357:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1789136126.607604:0:23357:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.156@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789136126.607620:0:23357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a0429a9c00/0xedd53ca6b6e470d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e470de expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136126.607658:0:23357:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.156@tcp lock: ffff94a0429a9c00/0xedd53ca6b6e470d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e470de expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789136126.607666:0:23357:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff949f449ce800 from 1 10000000:01000000:3.0:1789136126.607669:0:23357:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789136126.607694:0:23357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.156@tcp lock: ffff949f4483d400/0xedd53ca6b6e4716a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136126.607714:0:23357:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.156@tcp lock: ffff949f4483d400/0xedd53ca6b6e4716a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136126.607723:0:23357:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.156@tcp lock: ffff949f4483d400/0xedd53ca6b6e4716a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136126.607736:0:23357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a0556dfc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23357:1876044587190912:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789136126.607765:0:23357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136126.607778:0:23357:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a0516a1900 going to sleep for 11 seconds 00000100:00100000:0.0:1789136126.607987:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587190912 00000100:00100000:0.0:1789136126.607992:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587190912 00000100:00100000:0.0:1789136126.608026:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789136126.608034:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a076bd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+9:23357:x1876044587190912:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789136126.608043:0:23372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136126.608055:0:23372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94a0413fc200/0xedd53ca6b6e47171 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xedd53ca6b6e4716a expref: -99 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136126.608074:0:23372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94a0413fc200/0xedd53ca6b6e47171 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedd53ca6b6e4716a expref: 10 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136126.608084:0:23372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94a0413fc200/0xedd53ca6b6e47171 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedd53ca6b6e4716a expref: 10 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136126.608093:0:23372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94a0413fc200, rc 0) 00000100:00100000:0.0:1789136126.608125:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a076bd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+10:23357:x1876044587190912:12345-0@lo:101:mount.lustre.0 Request processed in 92us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136126.608131:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789136126.608283:0:23357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a0556dfc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23357:1876044587190912:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789136126.608296:0:23357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.156@tcp lock: ffff949f4483d400/0xedd53ca6b6e4716a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e47171 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136126.608305:0:23357:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.156@tcp lock: ffff949f4483d400/0xedd53ca6b6e4716a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xedd53ca6b6e47171 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136126.608974:0:23357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a0556dfc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23357:1876044587191040:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1789136126.609017:0:23357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136126.609094:0:23357:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a0516a1900 going to sleep for 11 seconds 00000100:00100000:2.0:1789136126.609240:0:23373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587191040 00000100:00100000:2.0:1789136126.609245:0:23373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587191040 00000100:00100000:2.0:1789136126.609309:0:23373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789136126.609317:0:23373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a076bd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3644072c-bb98-4fbe-9eaf-e40d57d161d0+10:23357:x1876044587191040:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1789136126.609332:0:23373:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789136126.609339:0:23373:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1789136126.609409:0:23373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a076bd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3644072c-bb98-4fbe-9eaf-e40d57d161d0+10:23357:x1876044587191040:12345-0@lo:256:mount.lustre.0 Request processed in 93us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136126.609416:0:23373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789136126.609495:0:23357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a0556dfc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23357:1876044587191040:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1789136126.610095:0:23357:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.156@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789136126.610109:0:23357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.156@tcp lock: ffff949f4483d400/0xedd53ca6b6e4716a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e47171 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136126.610119:0:23357:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.156@tcp lock: ffff949f4483d400/0xedd53ca6b6e4716a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e47171 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789136126.610140:0:23357:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff949f449ce800 from 1 10000000:01000000:3.0:1789136126.610143:0:23357:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789136126.610168:0:23357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.156@tcp lock: ffff949f4483d200/0xedd53ca6b6e47178 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136126.610174:0:23357:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.156@tcp lock: ffff949f4483d200/0xedd53ca6b6e47178 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136126.610182:0:23357:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.156@tcp lock: ffff949f4483d200/0xedd53ca6b6e47178 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136126.610195:0:23357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a0556dfc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23357:1876044587191168:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789136126.610230:0:23357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136126.610732:0:23357:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a0516a1900 going to sleep for 11 seconds 00000100:00100000:0.0:1789136126.610895:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587191168 00000100:00100000:0.0:1789136126.610910:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587191168 00000100:00100000:0.0:1789136126.610943:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789136126.610951:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a076bd1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+10:23357:x1876044587191168:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789136126.610961:0:23372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136126.610974:0:23372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94a0413fce00/0xedd53ca6b6e4717f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xedd53ca6b6e47178 expref: -99 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136126.610994:0:23372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94a0413fce00/0xedd53ca6b6e4717f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedd53ca6b6e47178 expref: 11 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136126.611004:0:23372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94a0413fce00/0xedd53ca6b6e4717f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedd53ca6b6e47178 expref: 11 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136126.611012:0:23372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94a0413fce00, rc 0) 00000100:00100000:0.0:1789136126.611051:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a076bd1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+11:23357:x1876044587191168:12345-0@lo:101:mount.lustre.0 Request processed in 101us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136126.611059:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789136126.611240:0:23357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a0556dfc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23357:1876044587191168:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789136126.611255:0:23357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.156@tcp lock: ffff949f4483d200/0xedd53ca6b6e47178 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e4717f expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136126.611263:0:23357:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.156@tcp lock: ffff949f4483d200/0xedd53ca6b6e47178 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xedd53ca6b6e4717f expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136126.611322:0:23357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a0556dfc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23357:1876044587191296:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789136126.611349:0:23357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136126.611403:0:23357:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a0516a1900 going to sleep for 11 seconds 00000100:00100000:0.0:1789136126.611450:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587191296 00000100:00100000:0.0:1789136126.611454:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587191296 00000100:00100000:0.0:1789136126.611589:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789136126.611597:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a076bd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+11:23357:x1876044587191296:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789136126.612014:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a076bd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+11:23357:x1876044587191296:12345-0@lo:501:mount.lustre.0 Request processed in 416us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136126.612021:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789136126.612086:0:23357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a0556dfc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23357:1876044587191296:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789136126.612119:0:23357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07ad9b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23357:1876044587191424:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789136126.612158:0:23357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136126.612215:0:23357:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a04903e900 going to sleep for 11 seconds 00000100:00100000:3.0:1789136126.613069:0:23371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587191424 00000100:00100000:3.0:1789136126.613078:0:23371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587191424 00000100:00100000:3.0:1789136126.613121:0:23371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789136126.613130:0:23371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a076bd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+11:23357:x1876044587191424:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789136126.613252:0:23371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a076bd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+11:23357:x1876044587191424:12345-0@lo:503:mount.lustre.0 Request processed in 124us (1093us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136126.613260:0:23371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789136126.613350:0:23357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07ad9b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23357:1876044587191424:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789136126.613725:0:23406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a0556dc780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23406:1876044587191552:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789136126.613766:0:23406:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136126.613807:0:23406:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a075d80a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789136126.613912:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587191552 00000100:00100000:0.0:1789136126.613923:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587191552 00000100:00100000:0.0:1789136126.613957:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789136126.613964:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a076bd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+11:23406:x1876044587191552:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789136126.614745:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a076bd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+11:23406:x1876044587191552:12345-0@lo:502:llog_process_th.0 Request processed in 779us (975us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136126.614754:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789136126.615037:0:23406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a0556dc780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23406:1876044587191552:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789136126.615066:0:23406:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789136126.615076:0:23406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136126.615079:0:23406:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789136126.615086:0:23406:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff949f449ce800 00000020:00000080:3.0:1789136126.615088:0:23406:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789136126.615095:0:23406:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789136126.615098:0:23406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136126.615099:0:23406:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789136126.615101:0:23406:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789136126.615104:0:23406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136126.615105:0:23406:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789136126.615107:0:23406:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff949f449ce800 00000020:00000080:3.0:1789136126.615109:0:23406:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789136126.615166:0:23406:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789136126.615169:0:23406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136126.615171:0:23406:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789136126.615173:0:23406:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789136126.615175:0:23406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136126.615176:0:23406:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789136126.615186:0:23406:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff949f449ce800 00000020:00000080:3.0:1789136126.615189:0:23406:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789136126.615208:0:23406:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789136126.615211:0:23406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136126.615212:0:23406:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789136126.615215:0:23406:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789136126.615217:0:23406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136126.615219:0:23406:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789136126.615222:0:23406:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff949f449ce800 00000020:00000080:3.0:1789136126.615224:0:23406:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789136126.615239:0:23406:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789136126.615242:0:23406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136126.615243:0:23406:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789136126.615245:0:23406:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789136126.615248:0:23406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136126.615249:0:23406:0:(obd_config.c:1563:class_process_config()) marker 6 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789136126.615253:0:23406:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff949f449ce800 00000020:00000080:3.0:1789136126.615255:0:23406:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789136126.615271:0:23406:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789136126.615274:0:23406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136126.615275:0:23406:0:(obd_config.c:1563:class_process_config()) marker 6 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789136126.615277:0:23406:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789136126.615280:0:23406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136126.615281:0:23406:0:(obd_config.c:1563:class_process_config()) marker 7 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789136126.615284:0:23406:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff949f449ce800 00000020:00000080:3.0:1789136126.615286:0:23406:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789136126.615323:0:23406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a0556dc780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23406:1876044587191680:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789136126.615366:0:23406:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136126.618666:0:23406:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a075d80a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789136126.619109:0:23371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587191680 00000100:00100000:1.0:1789136126.619118:0:23371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587191680 00000100:00100000:1.0:1789136126.619184:0:23371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789136126.619195:0:23371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a076bd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+11:23406:x1876044587191680:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789136126.619358:0:23371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a076bd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+11:23406:x1876044587191680:12345-0@lo:502:llog_process_th.0 Request processed in 164us (3990us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136126.619366:0:23371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789136126.619492:0:23406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a0556dc780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23406:1876044587191680:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789136126.619524:0:23406:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789136126.619536:0:23406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136126.619539:0:23406:0:(obd_config.c:1563:class_process_config()) marker 7 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789136126.619543:0:23406:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 19 count 19 00000020:01000000:1.0:1789136126.619795:0:23357:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-18 (rc=0) 10000000:01000000:1.0:1789136126.619817:0:23357:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789136126.619840:0:23357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.156@tcp lock: ffff949f4483d200/0xedd53ca6b6e47178 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e4717f expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136126.619862:0:23357:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.156@tcp lock: ffff949f4483d200/0xedd53ca6b6e47178 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e4717f expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789136126.619923:0:23357:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789136126.619927:0:23357:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff949f449ce800 10000000:01000000:1.0:1789136126.619930:0:23357:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff949f449ce800 10000000:01000000:1.0:1789136126.619934:0:23357:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789136126.619939:0:23357:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff949f449ce800 from 1 10000000:01000000:1.0:1789136126.619942:0:23357:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789136126.619971:0:23357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a07a32d800/0xedd53ca6b6e47186 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136126.619979:0:23357:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.156@tcp lock: ffff94a07a32d800/0xedd53ca6b6e47186 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136126.619988:0:23357:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.156@tcp lock: ffff94a07a32d800/0xedd53ca6b6e47186 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136126.620007:0:23357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4416e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23357:1876044587191808:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789136126.620046:0:23357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136126.620073:0:23357:0:(client.c:2715:ptlrpc_set_wait()) set ffff949f440fd180 going to sleep for 11 seconds 00000100:00100000:0.0:1789136126.620253:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587191808 00000100:00100000:0.0:1789136126.620258:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587191808 00000100:00100000:0.0:1789136126.620295:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789136126.620303:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a076bd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+11:23357:x1876044587191808:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789136126.620313:0:23372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136126.620324:0:23372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94a0413fd000/0xedd53ca6b6e4718d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xedd53ca6b6e47186 expref: -99 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136126.620344:0:23372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94a0413fd000/0xedd53ca6b6e4718d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedd53ca6b6e47186 expref: 12 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136126.620356:0:23372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94a0413fd000/0xedd53ca6b6e4718d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedd53ca6b6e47186 expref: 12 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136126.620364:0:23372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94a0413fd000, rc 0) 00000100:00100000:0.0:1789136126.620395:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a076bd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+12:23357:x1876044587191808:12345-0@lo:101:mount.lustre.0 Request processed in 92us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136126.620401:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789136126.623843:0:23357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4416e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23357:1876044587191808:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789136126.623869:0:23357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.156@tcp lock: ffff94a07a32d800/0xedd53ca6b6e47186 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e4718d expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136126.623888:0:23357:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.156@tcp lock: ffff94a07a32d800/0xedd53ca6b6e47186 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xedd53ca6b6e4718d expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136126.623983:0:23357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4416e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23357:1876044587191936:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789136126.624034:0:23357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136126.624064:0:23357:0:(client.c:2715:ptlrpc_set_wait()) set ffff949f440fd180 going to sleep for 11 seconds 00000100:00100000:0.0:1789136126.629595:0:23373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587191936 00000100:00100000:0.0:1789136126.630313:0:23373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587191936 00000100:00100000:0.0:1789136126.630369:0:23373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789136126.630379:0:23373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a076bd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3644072c-bb98-4fbe-9eaf-e40d57d161d0+12:23357:x1876044587191936:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789136126.630655:0:23373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a076bd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3644072c-bb98-4fbe-9eaf-e40d57d161d0+12:23357:x1876044587191936:12345-0@lo:501:mount.lustre.0 Request processed in 276us (6618us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136126.630662:0:23373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789136126.631981:0:23357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4416e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23357:1876044587191936:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789136126.632035:0:23357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4416e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23357:1876044587192064:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789136126.632094:0:23357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136126.632170:0:23357:0:(client.c:2715:ptlrpc_set_wait()) set ffff949f440fd180 going to sleep for 11 seconds 00000100:00100000:3.0:1789136126.634238:0:23371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587192064 00000100:00100000:3.0:1789136126.634249:0:23371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587192064 00000100:00100000:3.0:1789136126.634304:0:23371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789136126.634312:0:23371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a076bd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+12:23357:x1876044587192064:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789136126.634457:0:23371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a076bd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+12:23357:x1876044587192064:12345-0@lo:503:mount.lustre.0 Request processed in 144us (2362us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136126.634465:0:23371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789136126.634600:0:23357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4416e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23357:1876044587192064:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789136126.634859:0:23410:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a0556dc780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23410:1876044587192192:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789136126.634901:0:23410:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136126.634926:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587192192 00000100:00100000:3.0:1789136126.634931:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587192192 00000100:00100000:3.0:1789136126.634953:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789136126.634959:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a076bd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+12:23410:x1876044587192192:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789136126.635031:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a076bd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+12:23410:x1876044587192192:12345-0@lo:502:llog_process_th.0 Request processed in 71us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136126.635038:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789136126.635075:0:23410:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a075d806c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789136126.635088:0:23410:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a0556dc780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23410:1876044587192192:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1789136126.635135:0:23410:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1789136126.635149:0:23410:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff94a07549b490) 00000020:00000080:3.0:1789136126.635167:0:23410:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:3.0:1789136126.635251:0:23410:0:(tgt_mount.c:153:server_get_mount()) get mount ffff949f449ce800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789136126.635256:0:23410:0:(tgt_mount.c:187:server_put_mount()) put mount ffff949f449ce800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789136126.635258:0:23410:0:(obd_mount.c:710:lustre_put_lsi()) put ffff949f449ce800 4 00010000:00080000:3.0:1789136126.635294:0:23410:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94a081825800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.156@tcp at head 00010000:00010000:3.0:1789136126.637289:0:23410:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:3.0:1789136126.637500:0:23410:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1789136126.637540:0:23410:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789136126.637552:0:23410:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xedd53ca6b6e4719b 00000100:00080000:3.0:1789136126.637562:0:23410:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789136126.637568:0:23410:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff94a081825800 using connection 192.168.206.156@tcp/0@lo 00000100:00100000:3.0:1789136126.637697:0:23410:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94a0556dc780 x1876044587192320/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789136126.637721:0:23410:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789136126.637886:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a0556dc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876044587192320:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789136126.637956:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136126.640485:0:23378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587192320 00000100:00100000:3.0:1789136126.640496:0:23378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587192320 00000100:00100000:3.0:1789136126.640535:0:23378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789136126.640543:0:23378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a07ad9b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1876044587192320:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789136126.640817:0:23378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a07ad9b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1876044587192320:12345-0@lo:38:llog_process_th.0 Request processed in 273us (2860us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789136126.640825:0:23378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789136126.640883:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789136126.640891:0:3644:0:(import.c:65:import_set_state_nolock()) ffff94a081825800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789136126.640896:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789136126.640899:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a0556dc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876044587192320:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789136126.641009:0:23410:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a0556dc780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23410:1876044587192448:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789136126.641054:0:23410:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136126.641078:0:23373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587192448 00000100:00100000:3.0:1789136126.641081:0:23373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587192448 00000100:00100000:3.0:1789136126.641109:0:23373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789136126.641116:0:23373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a076bd0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3644072c-bb98-4fbe-9eaf-e40d57d161d0+12:23410:x1876044587192448:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789136126.641218:0:23373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a076bd0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3644072c-bb98-4fbe-9eaf-e40d57d161d0+12:23410:x1876044587192448:12345-0@lo:502:llog_process_th.0 Request processed in 102us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136126.641225:0:23373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789136126.641316:0:23410:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a075d80c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789136126.641328:0:23410:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a0556dc780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23410:1876044587192448:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789136126.641359:0:23410:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a0556dc780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23410:1876044587192576:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789136126.641389:0:23410:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136126.641492:0:23371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587192576 00000100:00100000:3.0:1789136126.641496:0:23371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587192576 00000100:00100000:3.0:1789136126.641516:0:23371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789136126.641522:0:23371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a076bd0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+12:23410:x1876044587192576:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789136126.641579:0:23371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a076bd0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+12:23410:x1876044587192576:12345-0@lo:502:llog_process_th.0 Request processed in 56us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136126.641585:0:23371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789136126.641739:0:23410:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a075d80c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789136126.641749:0:23410:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a0556dc780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23410:1876044587192576:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789136126.641766:0:23410:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1789136126.641814:0:23357:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1789136126.641832:0:23357:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789136126.641846:0:23357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a07a32d800/0xedd53ca6b6e47186 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e4718d expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136126.641856:0:23357:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.156@tcp lock: ffff94a07a32d800/0xedd53ca6b6e47186 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e4718d expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789136126.641900:0:23357:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789136126.641906:0:23357:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789136126.641907:0:23357:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789136126.641908:0:23357:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789136126.641909:0:23357:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789136126.641910:0:23357:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789136126.641912:0:23357:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789136126.641913:0:23357:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789136126.641914:0:23357:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789136126.641915:0:23357:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789136126.641919:0:23357:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1789136126.641921:0:23357:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789136126.641922:0:23357:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789136126.641923:0:23357:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789136126.641924:0:23357:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789136126.641925:0:23357:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789136126.641926:0:23357:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789136126.641927:0:23357:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789136126.641928:0:23357:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789136126.641929:0:23357:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789136126.641930:0:23357:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789136126.641942:0:23357:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789136126.641951:0:23357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a0556dc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23357:1876044587192704:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789136126.641979:0:23357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136126.641994:0:23357:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a075d80c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789136126.642012:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587192704 00000100:00100000:3.0:1789136126.642015:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587192704 00000100:00100000:3.0:1789136126.642035:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789136126.642041:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a049033c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+12:23357:x1876044587192704:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789136126.642060:0:23372:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789136126.642071:0:23372:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789136126.644579:0:23372:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789136126.644600:0:23372:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1789136126.645051:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a049033c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+12:23357:x1876044587192704:12345-0@lo:253:mount.lustre.0 Request processed in 3005us (3067us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136126.645062:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789136126.645130:0:23357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a0556dc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23357:1876044587192704:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789136126.645142:0:23357:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789136126.645145:0:23357:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789136126.645148:0:23357:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789136126.645149:0:23357:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789136126.645150:0:23357:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789136126.645151:0:23357:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789136126.645152:0:23357:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789136126.645153:0:23357:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789136126.645154:0:23357:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789136126.645156:0:23357:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789136126.645158:0:23357:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789136126.645170:0:23357:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1789136126.646140:0:23394:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789136126.646147:0:23394:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789136126.646169:0:23394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff94a0413fd400/0xedd53ca6b6e471a2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136126.646184:0:23394:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94a0413fc200/0xedd53ca6b6e47171 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedd53ca6b6e4716a expref: 11 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136126.646191:0:23394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff94a0413fd400/0xedd53ca6b6e471a2 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136126.646228:0:23394:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94a0413fc200/0xedd53ca6b6e47171 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xedd53ca6b6e4716a expref: 11 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136126.646252:0:23394:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94a0413fc200/0xedd53ca6b6e47171 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xedd53ca6b6e4716a expref: 11 pid: 23372 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136126.646266:0:23394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07ad9b480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23394:1876044587192832:0@lo:104: 00000100:00100000:0.0:1789136126.646312:0:23394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136126.646344:0:23394:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a080769cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789136126.655605:0:23361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587192832 00000100:00100000:3.0:1789136126.655615:0:23361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587192832 00000100:00100000:3.0:1789136126.655680:0:23361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789136126.655689:0:23361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a07ad9ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+3:23394:x1876044587192832:12345-0@lo:104: 00010000:00010000:3.0:1789136126.655708:0:23361:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.156@tcp lock: ffff949f4483d400/0xedd53ca6b6e4716a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xedd53ca6b6e47171 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136126.655995:0:23361:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789136126.656001:0:23361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a07ad9ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+3:23394:x1876044587192832:12345-0@lo:104: Request processed in 314us (9689us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136126.656009:0:23361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789136126.656111:0:23394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07ad9b480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23394:1876044587192832:0@lo:104: 00010000:00010000:3.0:1789136126.656132:0:23394:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff94a0413fd400/0xedd53ca6b6e471a2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136126.656564:0:23367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789136126.656571:0:23367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.156@tcp lock: ffff949f4483d400/0xedd53ca6b6e4716a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xedd53ca6b6e47171 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136126.656579:0:23367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff949f4483d400 already unused, calling callback (ffffffffc13c2c20) 10000000:00010000:2.0:1789136126.656582:0:23367:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.156@tcp lock: ffff949f4483d400/0xedd53ca6b6e4716a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xedd53ca6b6e47171 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136126.656590:0:23367:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.156@tcp lock: ffff949f4483d400/0xedd53ca6b6e4716a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xedd53ca6b6e47171 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789136126.656598:0:23367:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.156@tcp lock: ffff949f4483d400/0xedd53ca6b6e4716a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xedd53ca6b6e47171 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789136126.656604:0:23367:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789136126.656651:0:23367:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.156@tcp lock: ffff949f4483d400/0xedd53ca6b6e4716a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedd53ca6b6e47171 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136126.656658:0:23367:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789136126.656687:0:23367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.156@tcp lock: ffff949f4483d400/0xedd53ca6b6e4716a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedd53ca6b6e47171 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136126.656695:0:23367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.156@tcp lock: ffff949f4483d400/0xedd53ca6b6e4716a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedd53ca6b6e47171 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136126.656712:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136126.656714:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136126.656715:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789136126.656754:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a06f1a52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3644072c-bb98-4fbe-9eaf-e40d57d161d0:3645:1876044587192960:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789136126.656816:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136126.659051:0:23363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587192960 00000100:00100000:1.0:1789136126.659063:0:23363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587192960 00010000:00010000:1.0:1789136126.659093:0:23363:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94a0413fc200/0xedd53ca6b6e47171 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedd53ca6b6e4716a expref: 12 pid: 23372 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136126.659124:0:23363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789136126.659134:0:23363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a06f1a70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+12:3645:x1876044587192960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789136126.659146:0:23363:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789136126.659151:0:23363:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94a0413fc200/0xedd53ca6b6e47171 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedd53ca6b6e4716a expref: 12 pid: 23372 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136126.659162:0:23363:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94a0413fc200/0xedd53ca6b6e47171 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xedd53ca6b6e4716a expref: 12 pid: 23372 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136126.659182:0:23363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94a0413fc200/0xedd53ca6b6e47171 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xedd53ca6b6e4716a expref: 12 pid: 23372 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136126.659199:0:23363:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff94a0413fd400/0xedd53ca6b6e471a2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136126.659213:0:23363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94a0413fd400/0xedd53ca6b6e471a2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789136126.659228:0:23363:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.013081833s 00010000:00010000:1.0:1789136126.659233:0:23363:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94a0413fd400/0xedd53ca6b6e471a2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136126.659238:0:23363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94a0413fd400/0xedd53ca6b6e471a2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136126.659245:0:23363:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff94a0413fd400/0xedd53ca6b6e471a2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136126.659252:0:23363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff94a0413fd400/0xedd53ca6b6e471a2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136126.659259:0:23363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a0413fd400 already unused, calling callback (ffffffffc0d90550) 00010000:00010000:1.0:1789136126.659263:0:23363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff94a0413fd400/0xedd53ca6b6e471a2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136126.659271:0:23363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff94a0413fd400/0xedd53ca6b6e471a2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136126.659297:0:23363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff94a0413fd400/0xedd53ca6b6e471a2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136126.659308:0:23363:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789136126.659374:0:23363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a06f1a70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+11:3645:x1876044587192960:12345-0@lo:103:ldlm_bl.0 Request processed in 242us (2557us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136126.659382:0:23363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789136126.659434:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a06f1a52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3644072c-bb98-4fbe-9eaf-e40d57d161d0:3645:1876044587192960:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789136126.659563:0:23394:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff94a0413fd400/0xedd53ca6b6e471a2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136126.659572:0:23394:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff94a0413fd400/0xedd53ca6b6e471a2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136126.659579:0:23394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94a0413fd400/0xedd53ca6b6e471a2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789136126.667999:0:23357:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967531 00000040:01000000:2.0:1789136126.668554:0:23357:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1789136126.668678:0:23418:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967531 00000020:00080000:3.0:1789136126.668681:0:23418:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967531 00000040:01000000:0.0:1789136126.671081:0:23419:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789136126.673155:0:23357:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:0.0:1789136126.673495:0:23419:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:2.0:1789136126.674110:0:23422:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff94a06f1a5e00 x1876044587193088/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789136126.674122:0:23422:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a0483173c0 going to sleep for 0 seconds 00000040:00080000:0.0:1789136126.676078:0:23419:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789136126.676150:0:23419:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:01000000:1.0:1789136126.678441:0:23357:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1789136126.678593:0:23357:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1789136126.679066:0:23357:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1789136126.679074:0:23357:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1789136126.679113:0:23357:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789136126.682791:0:23357:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1789136126.683321:0:23357:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1789136126.683353:0:23357:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1789136126.684769:0:23357:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:1.0:1789136126.685208:0:23357:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:1.0:1789136126.690955:0:23357:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:1.0:1789136126.693624:0:23357:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1789136126.693762:0:23357:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb368c16db988 00100000:10000000:1.0:1789136126.693770:0:23357:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1789136126.694321:0:23357:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789136126.694336:0:23357:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.156@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789136126.694353:0:23357:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1789136126.694375:0:23357:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1789136126.695409:0:23357:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789136126.696059:0:23357:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789136127.289914:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789136127.668938:0:23417:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789136127.668951:0:23417:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789136127.677103:0:23417:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1789136127.677126:0:23417:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1789136127.730030:0:23422:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a0483173c0 going to sleep for 0 seconds 10000000:01000000:2.0:1789136128.112780:0:23375:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789136128.112787:0:23375:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff949f449ce800 from 11 10000000:01000000:2.0:1789136128.112792:0:23375:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789136128.112833:0:23375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a0429a8400/0xedd53ca6b6e471a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136128.112856:0:23375:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.156@tcp lock: ffff94a0429a8400/0xedd53ca6b6e471a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136128.112867:0:23375:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.156@tcp lock: ffff94a0429a8400/0xedd53ca6b6e471a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136128.112890:0:23375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a06f1a4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23375:1876044587193216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789136128.112955:0:23375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136128.112996:0:23375:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a048317b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789136128.113034:0:23373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587193216 00000100:00100000:3.0:1789136128.113047:0:23373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587193216 00000100:00100000:3.0:1789136128.113133:0:23373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789136128.113147:0:23373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a049032c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3644072c-bb98-4fbe-9eaf-e40d57d161d0+11:23375:x1876044587193216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789136128.113168:0:23373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789136128.113190:0:23373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff949f4483d800/0xedd53ca6b6e471b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xedd53ca6b6e471a9 expref: -99 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136128.113223:0:23373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff949f4483d800/0xedd53ca6b6e471b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedd53ca6b6e471a9 expref: 12 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136128.113238:0:23373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff949f4483d800/0xedd53ca6b6e471b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedd53ca6b6e471a9 expref: 12 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136128.113248:0:23373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff949f4483d800, rc 0) 00000100:00100000:3.0:1789136128.113600:0:23373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a049032c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3644072c-bb98-4fbe-9eaf-e40d57d161d0+12:23375:x1876044587193216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 455us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136128.113609:0:23373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789136128.115272:0:23375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a06f1a4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23375:1876044587193216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789136128.115311:0:23375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.156@tcp lock: ffff94a0429a8400/0xedd53ca6b6e471a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e471b0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136128.115334:0:23375:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.156@tcp lock: ffff94a0429a8400/0xedd53ca6b6e471a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xedd53ca6b6e471b0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136128.115430:0:23375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a06f1a4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23375:1876044587193344:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789136128.115766:0:23375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136128.115888:0:23375:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a048317b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789136128.119662:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587193344 00000100:00100000:3.0:1789136128.119678:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587193344 00000100:00100000:3.0:1789136128.120024:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789136128.120038:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a049030050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+12:23375:x1876044587193344:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789136128.120115:0:23372:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789136128.120230:0:23372:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789136128.120234:0:23372:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:3.0:1789136128.121001:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a049030050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+12:23375:x1876044587193344:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 961us (5231us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136128.121013:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789136128.121202:0:23375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a06f1a4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23375:1876044587193344:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789136128.121277:0:23375:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.156@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789136128.121293:0:23375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a0429a8400/0xedd53ca6b6e471a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e471b0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136128.121304:0:23375:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.156@tcp lock: ffff94a0429a8400/0xedd53ca6b6e471a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e471b0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136128.305714:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789136128.688818:0:23417:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789136128.688829:0:23417:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789136128.688962:0:23417:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:3.0:1789136128.688999:0:23417:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789136128.689155:0:23417:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000100:00100000:2.0:1789136128.753702:0:23422:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a0483173c0 going to sleep for 0 seconds 00010000:00010000:0.0:1789136129.328814:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789136129.786683:0:23422:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a0483173c0 going to sleep for 0 seconds 00010000:00010000:2.0:1789136130.352715:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789136130.802304:0:23422:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a0483173c0 going to sleep for 0 seconds 00000001:02000400:1.0:1789136131.275126:0:23666:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg656-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789136131.381753:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789136131.827954:0:23422:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a0483173c0 going to sleep for 0 seconds 00000100:00080000:2.0:1789136132.090489:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789136132.090496:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1789136132.090499:0:8:0:(import.c:65:import_set_state_nolock()) ffff94a076549800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789136132.090507:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 664 00000100:00080000:2.0:1789136132.090520:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789136132.090526:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff94a076549800 using connection 192.168.206.156@tcp/0@lo 00000100:00100000:2.0:1789136132.090570:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94a06f1a5a40 x1876044587193600/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789136132.090583:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789136132.090587:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789136132.090590:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789136132.090593:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789136132.090595:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789136132.090599:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789136132.090600:0:8:0:(import.c:65:import_set_state_nolock()) ffff94a081825800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789136132.090605:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff94a081825800 using connection 192.168.206.156@tcp/0@lo 00000100:00100000:2.0:1789136132.090617:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94a06f1a61c0 x1876044587193728/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789136132.090661:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789136132.090681:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a06f1a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3644072c-bb98-4fbe-9eaf-e40d57d161d0:3645:1876044587193472:0@lo:400:kworker.0 00000100:00100000:2.0:1789136132.090773:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136132.090843:0:23373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587193472 00000100:00100000:2.0:1789136132.090851:0:23373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587193472 00000100:00100000:2.0:1789136132.090905:0:23373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789136132.090916:0:23373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a049031850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3644072c-bb98-4fbe-9eaf-e40d57d161d0+12:3645:x1876044587193472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136132.090973:0:23373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a049031850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3644072c-bb98-4fbe-9eaf-e40d57d161d0+12:3645:x1876044587193472:12345-0@lo:400:kworker.0 Request processed in 59us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136132.090980:0:23373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789136132.091040:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a06f1a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3644072c-bb98-4fbe-9eaf-e40d57d161d0:3645:1876044587193472:0@lo:400:kworker.0 00000100:00100000:2.0:1789136132.095554:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a06f1a5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876044587193600:0@lo:38:kworker.0 00000100:00100000:2.0:1789136132.095654:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136132.095691:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a06f1a61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876044587193728:0@lo:38:kworker.0 00000100:00100000:2.0:1789136132.095721:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136132.096244:0:23380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587193728 00000100:00100000:0.0:1789136132.096252:0:23380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587193728 00000100:00100000:1.0:1789136132.096365:0:23384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587193600 00000100:00100000:1.0:1789136132.096370:0:23384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587193600 00000100:00100000:2.0:1789136132.096404:0:23380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789136132.096407:0:23384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789136132.096412:0:23380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a06f1a7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1876044587193728:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1789136132.096412:0:23384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a06f1a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1876044587193600:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1789136132.096437:0:23380:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 670 last 0 00010000:00020000:1.0:1789136132.096538:0:23384:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000020:00000080:2.0:1789136132.096551:0:23380:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xedd53ca6b6e471b7 00000004:00100000:2.0:1789136132.096565:0:23380:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:1.0:1789136132.096641:0:23384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a06f1a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1876044587193600:12345-0@lo:38:kworker.0 Request processed in 213us (972us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789136132.096649:0:23384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1789136132.096706:0:23380:0:(import.c:65:import_set_state_nolock()) ffff94a0754ab800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789136132.096745:0:23380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a06f1a7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876044587193728:12345-0@lo:38:kworker.0 Request processed in 333us (1023us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136132.096752:0:23380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1789136132.099188:0:3644:0:(import.c:65:import_set_state_nolock()) ffff94a076549800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789136132.099199:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789136132.099205:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a06f1a5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876044587193600:0@lo:38:kworker.0 00010000:00080000:1.0:1789136132.099734:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff94a06f1a61c0 x1876044587193728/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789136142 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789136132.099752:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1789136132.099760:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1789136132.099765:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789136132.099768:0:3644:0:(import.c:65:import_set_state_nolock()) ffff94a081825800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789136132.099774:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a06f1a61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876044587193728:0@lo:38:kworker.0 00000020:00000004:0.0:1789136132.132716:0:23719:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789136132.132889:0:23719:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789136132.400713:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789136132.848737:0:23422:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a0483173c0 going to sleep for 0 seconds 00000020:00000004:3.0:1789136132.978619:0:23769:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789136132.979086:0:23769:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789136133.424986:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136133.879396:0:23422:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a0483173c0 going to sleep for 0 seconds 00010000:00010000:2.0:1789136134.448870:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136134.896722:0:23422:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a0483173c0 going to sleep for 0 seconds 00010000:00010000:0.0:1789136135.475722:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136135.922705:0:23422:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a0483173c0 going to sleep for 0 seconds 00000100:00100000:1.0:1789136136.178899:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789136126/real 1789136126] req@ffff94a06f1a6940 x1876044587190656/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789136136 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136136.178937:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff94a06f1a6940 x1876044587190656/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789136136 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136136.178948:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789136126/real 1789136126] req@ffff949f4416f840 x1876044587190528/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789136136 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136136.178961:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff949f4416f840 x1876044587190528/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789136136 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789136136.178978:0:3644:0:(import.c:65:import_set_state_nolock()) ffff949f443e6800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789136136.178995:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789136136.178999:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a06f1a6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876044587190656:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1789136136.179005:0:3644:0:(import.c:65:import_set_state_nolock()) ffff949f443e6000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789136136.179024:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789136136.179028:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4416f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876044587190528:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1789136136.179103:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789136136.179107:0:479:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1789136136.179110:0:479:0:(import.c:65:import_set_state_nolock()) ffff94a076549800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789136136.179114:0:479:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 670 00000100:00080000:1.0:1789136136.179119:0:479:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789136136.179124:0:479:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff94a076549800 using connection 192.168.206.156@tcp/0@lo 00000100:00100000:1.0:1789136136.179144:0:479:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff949f4416c780 x1876044587193984/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789136136.179157:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789136136.179160:0:479:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789136136.179161:0:479:0:(import.c:65:import_set_state_nolock()) ffff949f443e6000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789136136.179165:0:479:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 664 00000100:00080000:1.0:1789136136.179168:0:479:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789136136.179171:0:479:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff949f443e6000 using connection 192.168.206.156@tcp/0@lo 00000100:00100000:1.0:1789136136.179181:0:479:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff949f4416f480 x1876044587194112/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789136136.179189:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789136136.179192:0:479:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789136136.179193:0:479:0:(import.c:65:import_set_state_nolock()) ffff949f443e6800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789136136.179197:0:479:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 664 00000100:00080000:1.0:1789136136.179199:0:479:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789136136.179202:0:479:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff949f443e6800 using connection 192.168.206.156@tcp/0@lo 00000100:00100000:1.0:1789136136.179218:0:479:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff949f4416d2c0 x1876044587194240/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789136136.179248:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4416c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876044587193984:0@lo:38:kworker.0 00000100:00100000:1.0:1789136136.179324:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136136.179364:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4416f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876044587194112:0@lo:8:kworker.0 00000400:00000100:1.0:1789136136.179386:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876044587194112 offset 0 length 520: 4 00000100:00100000:1.0:1789136136.179403:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4416d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876044587194240:0@lo:8:kworker.0 00000400:00000100:1.0:1789136136.179442:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876044587194240 offset 0 length 520: 4 00000100:00100000:1.0:1789136136.179469:0:23384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587193984 00000100:00100000:1.0:1789136136.179475:0:23384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587193984 00000100:00100000:3.0:1789136136.179506:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4416f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3644072c-bb98-4fbe-9eaf-e40d57d161d0:3647:1876044587193856:0@lo:400:kworker.0 00000100:00100000:1.0:1789136136.179512:0:23384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789136136.179521:0:23384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f4416da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1876044587193984:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1789136136.179538:0:23384:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789136136.179547:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136136.179572:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789136136.179579:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4416e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876044587194368:0@lo:400:kworker.0 00000100:00100000:1.0:1789136136.179589:0:23384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f4416da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1876044587193984:12345-0@lo:38:kworker.0 Request processed in 67us (264us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789136136.179598:0:23384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789136136.179645:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789136136.179656:0:3644:0:(import.c:65:import_set_state_nolock()) ffff94a076549800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789136136.179662:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789136136.179666:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4416c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876044587193984:0@lo:38:kworker.0 00000100:00100000:3.0:1789136136.179702:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587193856 00000100:00100000:3.0:1789136136.179706:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587193856 00000100:00100000:3.0:1789136136.179743:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789136136.179750:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a049030850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+12:3647:x1876044587193856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136136.179787:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a049030850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+12:3647:x1876044587193856:12345-0@lo:400:kworker.0 Request processed in 39us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136136.179793:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789136136.179832:0:23378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587194368 00000100:00100000:3.0:1789136136.179843:0:23378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587194368 00000100:00100000:3.0:1789136136.179871:0:23378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789136136.179877:0:23378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0556ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876044587194368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136136.179914:0:23378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0556ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876044587194368:12345-0@lo:400:kworker.0 Request processed in 37us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136136.179921:0:23378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789136136.180022:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff949f4416e580 x1876044587194368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136136.180035:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4416e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876044587194368:0@lo:400:kworker.0 00000100:00100000:3.0:1789136136.180048:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4416f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3644072c-bb98-4fbe-9eaf-e40d57d161d0:3647:1876044587193856:0@lo:400:kworker.0 00010000:00010000:2.0:1789136136.496781:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136136.946714:0:23422:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a0483173c0 going to sleep for 0 seconds 00010000:00010000:3.0:1789136137.520742:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136137.969768:0:23422:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a0483173c0 going to sleep for 0 seconds 00010000:00010000:0.0:1789136138.547497:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789136138.930943:0:23417:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789136139.000107:0:23422:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a0483173c0 going to sleep for 0 seconds 00010000:00010000:1.0:1789136139.569043:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789136139.776377:0:24114:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789136139.776381:0:24114:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1789136139.776383:0:24114:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1789136139.777586:0:24114:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff949f43b2f800 00000020:01000004:3.0:1789136139.777605:0:24114:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:3.0:1789136139.777618:0:24114:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789136139.778501:0:24114:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff94a075498000) 00000020:00000080:3.0:1789136139.778524:0:24114:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789136139.848654:0:24114:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1789136139.849173:0:24114:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1789136139.852230:0:24114:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1789136139.852660:0:24114:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1789136139.852942:0:24114:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:2.0:1789136139.853789:0:24114:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1789136139.855059:0:24114:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1789136139.859600:0:24114:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1789136139.860169:0:24114:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1789136139.860473:0:24114:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:2.0:1789136139.860700:0:24114:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1789136139.860954:0:24114:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1789136139.861285:0:24114:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:3.0:1789136139.865921:0:24114:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1789136139.866946:0:24114:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1789136139.867173:0:24114:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1789136139.867483:0:24114:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1789136139.867827:0:24114:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:3.0:1789136139.868374:0:24114:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1789136139.868657:0:24114:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1789136139.869039:0:24114:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1789136139.869290:0:24114:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:3.0:1789136139.869554:0:24114:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1789136139.870007:0:24114:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:3.0:1789136139.870202:0:24114:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1789136139.870940:0:24114:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1789136139.872871:0:24114:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:3.0:1789136139.873310:0:24114:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1789136139.873571:0:24114:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1789136139.873934:0:24114:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1789136139.874184:0:24114:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1789136139.874441:0:24114:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:3.0:1789136139.875533:0:24114:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1789136139.876508:0:24114:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1789136139.877985:0:24114:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1789136139.878344:0:24114:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:3.0:1789136139.878619:0:24114:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:3.0:1789136139.879268:0:24114:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1789136139.879572:0:24114:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:3.0:1789136139.879888:0:24114:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:3.0:1789136139.880235:0:24114:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1789136139.880502:0:24114:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1789136139.880824:0:24114:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1789136139.881023:0:24114:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:3.0:1789136139.881208:0:24114:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:3.0:1789136139.881458:0:24114:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00080000:01000000:3.0:1789136139.882185:0:24114:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789136139.882389:0:24114:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1789136139.882416:0:24114:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789136139.882428:0:24114:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xedd53ca6b6e471c5 00000020:01000004:3.0:1789136139.882434:0:24114:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1789136139.882454:0:24114:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.156@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789136139.882457:0:24114:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.156@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789136139.882463:0:24114:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1789136139.882490:0:24114:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1789136139.882494:0:24114:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.156@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1789136139.891248:0:24114:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.156@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789136139.891296:0:24114:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.206.156@tcp, index=0001, flags=0x20001 00000020:01000004:2.0:1789136139.891301:0:24114:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789136139.891303:0:24114:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789136139.891304:0:24114:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789136139.891305:0:24114:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789136139.891306:0:24114:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789136139.891308:0:24114:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789136139.891309:0:24114:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789136139.891311:0:24114:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789136139.891313:0:24114:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789136139.891316:0:24114:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:2.0:1789136139.891318:0:24114:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789136139.891320:0:24114:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789136139.891321:0:24114:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789136139.891322:0:24114:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789136139.891323:0:24114:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789136139.891324:0:24114:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789136139.891325:0:24114:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789136139.891326:0:24114:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789136139.891327:0:24114:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789136139.891353:0:24114:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1789136139.891373:0:24114:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a06f1a6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24114:1876044587194496:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789136139.891460:0:24114:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136139.891507:0:24114:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a06229b240 going to sleep for 11 seconds 00000100:00100000:1.0:1789136139.891786:0:23371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587194496 00000100:00100000:1.0:1789136139.891794:0:23371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587194496 00000100:00100000:1.0:1789136139.891851:0:23371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789136139.891861:0:23371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a049031c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+12:24114:x1876044587194496:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789136139.891889:0:23371:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1789136139.891899:0:23371:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:1.0:1789136139.891907:0:23371:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1789136139.892412:0:23371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a049031c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+12:24114:x1876044587194496:12345-0@lo:253:mount.lustre.0 Request processed in 533us (933us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136139.892421:0:23371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789136139.892545:0:24114:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a06f1a6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24114:1876044587194496:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789136139.892555:0:24114:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1789136139.892557:0:24114:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789136139.892559:0:24114:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789136139.892567:0:24114:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789136139.892568:0:24114:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789136139.892569:0:24114:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789136139.892570:0:24114:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789136139.892571:0:24114:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789136139.892572:0:24114:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789136139.892573:0:24114:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789136139.892591:0:24114:0:(tgt_mount.c:101:server_register_mount()) register mount ffff949f43b2f800 from lustre-MDT0001 10000000:01000000:2.0:1789136139.892617:0:24114:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1789136139.892619:0:24114:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1789136139.892660:0:24114:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff949f44320000 local copy 00010000:00010000:2.0:1789136139.892677:0:24114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a0429a9600/0xedd53ca6b6e470bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e470c2 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136139.892766:0:24114:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a06f1a6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24114:1876044587194624:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789136139.892798:0:24114:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136139.892823:0:24114:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a05020d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789136139.892966:0:23373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587194624 00000100:00100000:1.0:1789136139.892971:0:23373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587194624 00000100:00100000:1.0:1789136139.893084:0:23373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789136139.893093:0:23373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a049032450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3644072c-bb98-4fbe-9eaf-e40d57d161d0+12:24114:x1876044587194624:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789136139.893167:0:23373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a049032450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3644072c-bb98-4fbe-9eaf-e40d57d161d0+12:24114:x1876044587194624:12345-0@lo:501:mount.lustre.0 Request processed in 76us (368us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789136139.893174:0:23373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789136139.893234:0:24114:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a06f1a6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24114:1876044587194624:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789136139.893249:0:24114:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.156@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789136139.893270:0:24114:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.156@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789136139.893276:0:24114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a0429a9600/0xedd53ca6b6e470bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e470c2 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136139.893284:0:24114:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.156@tcp lock: ffff94a0429a9600/0xedd53ca6b6e470bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e470c2 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789136139.893307:0:24114:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff949f43b2f800 10000000:01000000:2.0:1789136139.893311:0:24114:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789136139.893316:0:24114:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff949f44320000 10000000:01000000:2.0:1789136139.893318:0:24114:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1789136139.893322:0:24114:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff949f44320000 from 1 10000000:01000000:2.0:1789136139.893333:0:24114:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789136139.893358:0:24114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a0429a8a00/0xedd53ca6b6e471cc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136139.893366:0:24114:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.156@tcp lock: ffff94a0429a8a00/0xedd53ca6b6e471cc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136139.893375:0:24114:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.156@tcp lock: ffff94a0429a8a00/0xedd53ca6b6e471cc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136139.893389:0:24114:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a06f1a6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24114:1876044587194752:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789136139.893434:0:24114:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136139.918389:0:24114:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a05020d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789136139.918775:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587194752 00000100:00100000:3.0:1789136139.918784:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587194752 00000100:00100000:3.0:1789136139.918835:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789136139.918843:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a049031450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+12:24114:x1876044587194752:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789136139.918858:0:23372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789136139.918876:0:23372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff949f4483c000/0xedd53ca6b6e471d3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xedd53ca6b6e471cc expref: -99 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136139.918900:0:23372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff949f4483c000/0xedd53ca6b6e471d3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedd53ca6b6e471cc expref: 13 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136139.918910:0:23372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff949f4483c000/0xedd53ca6b6e471d3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedd53ca6b6e471cc expref: 13 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136139.918919:0:23372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff949f4483c000, rc 0) 00000100:00100000:3.0:1789136139.918972:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a049031450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+13:24114:x1876044587194752:12345-0@lo:101:mount.lustre.0 Request processed in 130us (25537us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136139.918978:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789136139.919168:0:24114:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a06f1a6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24114:1876044587194752:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789136139.919185:0:24114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.156@tcp lock: ffff94a0429a8a00/0xedd53ca6b6e471cc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e471d3 expref: -99 pid: 24114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136139.919194:0:24114:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.156@tcp lock: ffff94a0429a8a00/0xedd53ca6b6e471cc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xedd53ca6b6e471d3 expref: -99 pid: 24114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789136139.919213:0:24114:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.156@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789136139.919232:0:24114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a0429a8a00/0xedd53ca6b6e471cc lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e471d3 expref: -99 pid: 24114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136139.919240:0:24114:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.156@tcp lock: ffff94a0429a8a00/0xedd53ca6b6e471cc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e471d3 expref: -99 pid: 24114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789136139.919251:0:24114:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff949f43b2f800 10000000:01000000:2.0:1789136139.919255:0:24114:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1789136139.919273:0:24114:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff949f43b2f800 from 1 10000000:01000000:2.0:1789136139.919275:0:24114:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1789136139.919299:0:24114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a0429a8200/0xedd53ca6b6e471da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136139.919306:0:24114:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.156@tcp lock: ffff94a0429a8200/0xedd53ca6b6e471da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136139.919313:0:24114:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.156@tcp lock: ffff94a0429a8200/0xedd53ca6b6e471da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136139.919332:0:24114:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a06f1a6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24114:1876044587194880:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789136139.919363:0:24114:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136139.919380:0:24114:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a05020d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789136139.919532:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587194880 00000100:00100000:3.0:1789136139.919537:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587194880 00000100:00100000:3.0:1789136139.919562:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789136139.919568:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a049030c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+13:24114:x1876044587194880:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789136139.919581:0:23372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789136139.919590:0:23372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff949f4483d400/0xedd53ca6b6e471e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xedd53ca6b6e471da expref: -99 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136139.919604:0:23372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff949f4483d400/0xedd53ca6b6e471e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedd53ca6b6e471da expref: 14 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136139.919612:0:23372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff949f4483d400/0xedd53ca6b6e471e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedd53ca6b6e471da expref: 14 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136139.919620:0:23372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff949f4483d400, rc 0) 00000100:00100000:3.0:1789136139.919693:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a049030c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+14:24114:x1876044587194880:12345-0@lo:101:mount.lustre.0 Request processed in 125us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136139.919700:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789136139.922692:0:24114:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a06f1a6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24114:1876044587194880:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789136139.922720:0:24114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.156@tcp lock: ffff94a0429a8200/0xedd53ca6b6e471da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e471e1 expref: -99 pid: 24114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136139.922733:0:24114:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.156@tcp lock: ffff94a0429a8200/0xedd53ca6b6e471da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xedd53ca6b6e471e1 expref: -99 pid: 24114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789136139.922752:0:24114:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.156@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1789136139.922767:0:24114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a0429a8200/0xedd53ca6b6e471da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e471e1 expref: -99 pid: 24114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136139.922774:0:24114:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.156@tcp lock: ffff94a0429a8200/0xedd53ca6b6e471da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e471e1 expref: -99 pid: 24114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789136139.922782:0:24114:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1789136139.922802:0:24114:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789136139.922809:0:24114:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff949f43b2f800 10000000:01000000:2.0:1789136139.922811:0:24114:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1789136139.922816:0:24114:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1789136139.922818:0:24114:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1789136139.922849:0:24114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a0429a8c00/0xedd53ca6b6e471e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136139.922856:0:24114:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.156@tcp lock: ffff94a0429a8c00/0xedd53ca6b6e471e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136139.922864:0:24114:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.156@tcp lock: ffff94a0429a8c00/0xedd53ca6b6e471e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136139.922882:0:24114:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a06f1a6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24114:1876044587195008:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789136139.922942:0:24114:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136139.922983:0:24114:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a05020d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789136139.923084:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587195008 00000100:00100000:1.0:1789136139.923090:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587195008 00000100:00100000:1.0:1789136139.923134:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789136139.923143:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a049032050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+14:24114:x1876044587195008:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789136139.923155:0:23372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789136139.923165:0:23372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94a07a32de00/0xedd53ca6b6e471ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xedd53ca6b6e471e8 expref: -99 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136139.923184:0:23372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94a07a32de00/0xedd53ca6b6e471ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedd53ca6b6e471e8 expref: 15 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136139.923193:0:23372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94a07a32de00/0xedd53ca6b6e471ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedd53ca6b6e471e8 expref: 15 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136139.923201:0:23372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94a07a32de00, rc 0) 00000100:00100000:1.0:1789136139.923233:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a049032050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+15:24114:x1876044587195008:12345-0@lo:101:mount.lustre.0 Request processed in 91us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136139.923247:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789136139.926649:0:24114:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a06f1a6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24114:1876044587195008:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789136139.926693:0:24114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.156@tcp lock: ffff94a0429a8c00/0xedd53ca6b6e471e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e471ef expref: -99 pid: 24114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136139.926707:0:24114:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.156@tcp lock: ffff94a0429a8c00/0xedd53ca6b6e471e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xedd53ca6b6e471ef expref: -99 pid: 24114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789136139.928329:0:24114:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:2.0:1789136139.929191:0:24114:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789136139.934775:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1789136139.934835:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:2.0:1789136139.934852:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:2.0:1789136139.934863:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:2.0:1789136139.934888:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:2.0:1789136139.934902:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:2.0:1789136139.934914:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:2.0:1789136139.934928:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:2.0:1789136139.934940:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:2.0:1789136139.934952:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:2.0:1789136139.934966:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:2.0:1789136139.934979:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:2.0:1789136139.934991:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:2.0:1789136139.935004:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:2.0:1789136139.935018:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:2.0:1789136139.935032:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:2.0:1789136139.935049:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:2.0:1789136139.935063:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:2.0:1789136139.935075:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:2.0:1789136139.935088:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:2.0:1789136139.935103:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:2.0:1789136139.935116:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:2.0:1789136139.935130:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:2.0:1789136139.935144:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:2.0:1789136139.935160:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:2.0:1789136139.935173:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:2.0:1789136139.935187:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:2.0:1789136139.935199:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:2.0:1789136139.935211:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:2.0:1789136139.935223:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:2.0:1789136139.935235:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:2.0:1789136139.935246:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:2.0:1789136139.935260:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:2.0:1789136139.935275:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:2.0:1789136139.935288:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:2.0:1789136139.935302:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:2.0:1789136139.935316:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:2.0:1789136139.935339:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:2.0:1789136139.935352:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:2.0:1789136139.935363:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:2.0:1789136139.935374:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:2.0:1789136139.935385:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:2.0:1789136139.935396:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:2.0:1789136139.935419:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:2.0:1789136139.935445:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:2.0:1789136139.935451:0:24114:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:2.0:1789136139.935546:0:24114:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a06f1a6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24114:1876044587195136:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789136139.935606:0:24114:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136139.936013:0:24114:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a05020d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789136139.938978:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587195136 00000100:00100000:1.0:1789136139.938991:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587195136 00000100:00100000:0.0:1789136139.939149:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789136139.939159:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a049033450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+15:24114:x1876044587195136:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789136139.939346:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a049033450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+15:24114:x1876044587195136:12345-0@lo:501:mount.lustre.0 Request processed in 188us (3739us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136139.939353:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789136139.939548:0:24114:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a06f1a6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24114:1876044587195136:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789136139.939597:0:24114:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4416de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24114:1876044587195264:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789136139.939764:0:24114:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136139.939800:0:24114:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a0432cfe40 going to sleep for 11 seconds 00000100:00100000:0.0:1789136139.939861:0:23371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587195264 00000100:00100000:0.0:1789136139.939866:0:23371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587195264 00000100:00100000:0.0:1789136139.939906:0:23371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789136139.939912:0:23371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a049030450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+15:24114:x1876044587195264:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789136139.940518:0:23371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a049030450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+15:24114:x1876044587195264:12345-0@lo:503:mount.lustre.0 Request processed in 604us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136139.940527:0:23371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789136139.940764:0:24114:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4416de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24114:1876044587195264:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789136139.941171:0:24114:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789136139.941249:0:24114:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4416de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24114:1876044587195392:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789136139.941298:0:24114:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136139.941334:0:24114:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a076942300 going to sleep for 11 seconds 00000100:00100000:2.0:1789136139.941758:0:23373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587195392 00000100:00100000:2.0:1789136139.941764:0:23373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587195392 00000100:00100000:2.0:1789136139.941808:0:23373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789136139.941816:0:23373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a049032850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3644072c-bb98-4fbe-9eaf-e40d57d161d0+15:24114:x1876044587195392:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789136139.942348:0:23373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a049032850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3644072c-bb98-4fbe-9eaf-e40d57d161d0+15:24114:x1876044587195392:12345-0@lo:502:mount.lustre.0 Request processed in 530us (1049us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136139.942357:0:23373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789136139.943758:0:24114:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4416de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24114:1876044587195392:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789136139.944022:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1789136139.944054:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:1.0:1789136139.944072:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:1.0:1789136139.944091:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:1.0:1789136139.944106:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:1.0:1789136139.944119:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:1.0:1789136139.944134:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:1.0:1789136139.944147:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:1.0:1789136139.944161:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:1.0:1789136139.944174:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:1.0:1789136139.944188:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:1.0:1789136139.944203:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:1.0:1789136139.944223:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:1.0:1789136139.944236:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:1.0:1789136139.944261:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:1.0:1789136139.944276:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:1.0:1789136139.944290:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:1.0:1789136139.944304:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:1.0:1789136139.944318:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:1.0:1789136139.944332:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:1.0:1789136139.944344:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:1.0:1789136139.944360:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:1.0:1789136139.944374:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:1.0:1789136139.944387:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:1.0:1789136139.947887:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:1.0:1789136139.947926:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:1.0:1789136139.947942:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:1.0:1789136139.947957:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:1.0:1789136139.947972:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:1.0:1789136139.947984:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:1.0:1789136139.947996:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:1.0:1789136139.948009:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:1.0:1789136139.948023:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:1.0:1789136139.948038:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:1.0:1789136139.948050:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:1.0:1789136139.948063:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:1.0:1789136139.948076:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:1.0:1789136139.948090:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:1.0:1789136139.948103:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:1.0:1789136139.948117:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:1.0:1789136139.948131:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:1.0:1789136139.948146:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:1.0:1789136139.948158:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:1.0:1789136139.948170:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:1.0:1789136139.948221:0:24114:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4416de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24114:1876044587195520:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789136139.948304:0:24114:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136139.948344:0:24114:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a076942300 going to sleep for 11 seconds 00000100:00100000:0.0:1789136139.949802:0:23371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587195520 00000100:00100000:0.0:1789136139.949814:0:23371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587195520 00000100:00100000:0.0:1789136139.949883:0:23371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789136139.949893:0:23371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f43751c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+15:24114:x1876044587195520:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789136139.950047:0:23371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f43751c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+15:24114:x1876044587195520:12345-0@lo:502:mount.lustre.0 Request processed in 154us (1742us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136139.950055:0:23371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789136139.950344:0:24114:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4416de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24114:1876044587195520:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789136139.950438:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:1.0:1789136139.950451:0:24114:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:2.0:1789136139.951690:0:24118:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789136139.951705:0:24118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789136139.951708:0:24118:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1789136139.951714:0:24118:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1789136139.951717:0:24118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789136139.951733:0:24118:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff94a07ad33490) 00000020:00000080:2.0:1789136139.951754:0:24118:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:2.0:1789136139.951760:0:24118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1789136139.951832:0:24118:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789136139.951839:0:24118:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xedd53ca6b6e471fd 00000020:00000080:2.0:1789136139.952039:0:24118:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1789136139.952043:0:24118:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789136139.952056:0:24118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789136139.952058:0:24118:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1789136139.952062:0:24118:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789136139.952065:0:24118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789136139.952067:0:24118:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1789136139.952070:0:24118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789136139.952077:0:24118:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff94a07ad30000) 00000020:00000080:2.0:1789136139.952087:0:24118:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:2.0:1789136139.952091:0:24118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1789136139.952094:0:24118:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1789136139.952097:0:24118:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1789136139.952102:0:24118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789136139.952161:0:24118:0:(tgt_mount.c:153:server_get_mount()) get mount ffff949f43b2f800 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1789136139.952174:0:24118:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff94a07ad34ed8) 00000020:00000080:2.0:1789136139.952183:0:24118:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:2.0:1789136139.952231:0:24118:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:2.0:1789136139.952236:0:24118:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xedd53ca6b6e47212 00000020:00000080:2.0:1789136139.952322:0:24118:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1789136139.952328:0:24118:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1789136139.952332:0:24118:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xedd53ca6b6e47219 00080000:01000000:2.0:1789136139.952337:0:24118:0:(osd_handler.c:8895:osd_obd_connect()) connect #2 00000020:00000080:2.0:1789136139.952339:0:24118:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xedd53ca6b6e47220 00000100:00100000:1.0:1789136140.016894:0:23422:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a0483173c0 going to sleep for 0 seconds 00010000:00010000:1.0:1789136140.030879:0:24118:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:1.0:1789136140.031472:0:24118:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:1.0:1789136140.032461:0:24118:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1789136140.035373:0:24118:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1789136140.035386:0:24118:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789136140.035393:0:24118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136140.035395:0:24118:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1789136140.035399:0:24118:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789136140.035414:0:24118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136140.035416:0:24118:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1789136140.035419:0:24118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789136140.035424:0:24118:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.156@tcp to nid 0x20000c0a8ce9c (192.168.206.156@tcp) 00000020:00000080:1.0:1789136140.035462:0:24118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789136140.035477:0:24118:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff94a043763490) 00000020:00000080:1.0:1789136140.035499:0:24118:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:1.0:1789136140.035505:0:24118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789136140.035573:0:24118:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1789136140.035581:0:24118:0:(osd_handler.c:8895:osd_obd_connect()) connect #3 00000020:00000080:1.0:1789136140.035587:0:24118:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xedd53ca6b6e4722e 00010000:00080000:1.0:1789136140.035614:0:24118:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94a081a84000@lustre-MDT0000-osp-MDT0001: add connection 192.168.206.156@tcp at head 00010000:00010000:1.0:1789136140.037277:0:24118:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:0.0:1789136140.040270:0:24118:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789136140.040286:0:24118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1789136140.040321:0:24118:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789136140.040343:0:24118:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xedd53ca6b6e47235 00000100:00080000:0.0:1789136140.040353:0:24118:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789136140.040358:0:24118:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff94a081a84000 using connection 192.168.206.156@tcp/0@lo 00000100:00100000:0.0:1789136140.040393:0:24118:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94a07ad992c0 x1876044587195648/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789136140.040463:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07ad992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876044587195648:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789136140.040531:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789136140.040586:0:24118:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789136140.040615:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789136140.040619:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1789136140.040621:0:8:0:(import.c:65:import_set_state_nolock()) ffff94a076549800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789136140.040648:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 674 00000100:00080000:0.0:1789136140.040653:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1789136140.040678:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff94a076549800 using connection 192.168.206.156@tcp/0@lo 00000100:00100000:0.0:1789136140.040694:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94a07ad9a940 x1876044587195776/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789136140.040801:0:23384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587195648 00000100:00100000:1.0:1789136140.040809:0:23384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587195648 00000100:00100000:1.0:1789136140.040840:0:23384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789136140.040848:0:23384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0556dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1876044587195648:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789136140.047906:0:23384:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 678 last 0 00000020:00000080:1.0:1789136140.047958:0:23384:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xedd53ca6b6e4723c 00000004:00100000:1.0:1789136140.047976:0:23384:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1789136140.047984:0:23384:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000020:01000000:1.0:1789136140.048164:0:24118:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789136140.048170:0:24118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136140.048172:0:24118:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1789136140.048176:0:24118:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789136140.048178:0:24118:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1789136140.048179:0:24118:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789136140.048181:0:24118:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789136140.048182:0:24118:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789136140.048185:0:24118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136140.048186:0:24118:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789136140.048189:0:24118:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789136140.048194:0:24118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136140.048195:0:24118:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1789136140.048199:0:24118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1789136140.048251:0:24118:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1789136140.048269:0:24118:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789136140.048272:0:24118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136140.048274:0:24118:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1789136140.048277:0:24118:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789136140.048278:0:24118:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:1.0:1789136140.048280:0:24118:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789136140.048281:0:24118:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789136140.048283:0:24118:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789136140.048285:0:24118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136140.048286:0:24118:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789136140.048288:0:24118:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789136140.048292:0:24118:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1789136140.048295:0:24118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136140.048307:0:24118:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789136140.048311:0:24118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789136140.048314:0:24118:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.156@tcp to nid 0x20000c0a8ce9c (192.168.206.156@tcp) 00000020:01000000:1.0:1789136140.048334:0:24118:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1789136140.048337:0:24118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789136140.048351:0:24118:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff94a043760000) 00000020:00000080:1.0:1789136140.048364:0:24118:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1789136140.048369:0:24118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789136140.048456:0:24118:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1789136140.048463:0:24118:0:(osd_handler.c:8895:osd_obd_connect()) connect #4 00000020:00000080:1.0:1789136140.048469:0:24118:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xedd53ca6b6e4724a 00010000:00080000:1.0:1789136140.048506:0:24118:0:(ldlm_lib.c:102:import_set_conn()) imp ffff949f42648800@lustre-OST0000-osc-MDT0001: add connection 192.168.206.156@tcp at head 00010000:00010000:1.0:1789136140.048769:0:24118:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:3.0:1789136140.051227:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07ad9a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876044587195776:0@lo:38:kworker.0 00000100:00100000:3.0:1789136140.051309:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789136140.054598:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789136140.054609:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789136140.054611:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789136140.054614:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789136140.054702:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07ad9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876044587195904:0@lo:400:kworker.0 00000100:00100000:0.0:1789136140.054775:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136140.054846:0:23379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587195904 00000100:00100000:0.0:1789136140.054854:0:23379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587195904 00000100:00100000:0.0:1789136140.054899:0:23379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789136140.054909:0:23379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a07ad9a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876044587195904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136140.054959:0:23379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a07ad9a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876044587195904:12345-0@lo:400:kworker.0 Request processed in 52us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136140.054966:0:23379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789136140.055004:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff94a07ad9b480 x1876044587195904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136156 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136140.055018:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07ad9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876044587195904:0@lo:400:kworker.0 00000100:00100000:1.0:1789136140.055602:0:23383:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:1.0:1789136140.055611:0:23383:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:0.0:1789136140.056341:0:23383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587195776 00000100:00100000:0.0:1789136140.056348:0:23383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587195776 00000100:00100000:1.0:1789136140.056481:0:24123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789136140.056487:0:24123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0556de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3644:x1876044587195776:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1789136140.056568:0:24123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0556de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3644:x1876044587195776:12345-0@lo:38:kworker.0 Request processed in 79us (5258us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789136140.056575:0:24123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789136140.056712:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789136140.056720:0:3644:0:(import.c:65:import_set_state_nolock()) ffff94a076549800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789136140.056725:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789136140.056728:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07ad9a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876044587195776:0@lo:38:kworker.0 00000040:01000000:3.0:1789136140.057145:0:24118:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00080000:1.0:1789136140.057995:0:23384:0:(import.c:65:import_set_state_nolock()) ffff949f45097800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789136140.058071:0:23384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0556dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3644:x1876044587195648:12345-0@lo:38:llog_process_th.0 Request processed in 17221us (17538us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136140.058079:0:23384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789136140.058154:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789136140.058162:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1789136140.058169:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1789136140.058174:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789136140.058176:0:3644:0:(import.c:65:import_set_state_nolock()) ffff94a081a84000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789136140.058199:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07ad992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876044587195648:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789136140.059124:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789136140.059151:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a0556dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876044587196032:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789136140.059202:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136140.059255:0:23383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587196032 00000100:00100000:0.0:1789136140.059261:0:23383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587196032 00000100:00100000:0.0:1789136140.059304:0:23383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789136140.059312:0:23383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a07ad9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3645:x1876044587196032:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789136140.059340:0:23383:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1789136140.059422:0:23383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a07ad9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3645:x1876044587196032:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136140.059428:0:23383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789136140.059473:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a0556dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876044587196032:0@lo:41:osp-pre-0-1.0 00000040:01000000:2.0:1789136140.065976:0:24118:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1789136140.070564:0:24118:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789136140.070814:0:24118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:2.0:1789136140.070940:0:24118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1789136140.071861:0:24124:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1789136140.071866:0:24124:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1789136140.072424:0:24118:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789136140.072437:0:24118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789136140.072476:0:24118:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789136140.072496:0:24118:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xedd53ca6b6e47251 00000100:00080000:3.0:1789136140.072505:0:24118:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789136140.072512:0:24118:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff949f42648800 using connection 192.168.206.156@tcp/0@lo 00000100:00100000:3.0:1789136140.072545:0:24118:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94a0556dcf00 x1876044587196160/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789136140.072581:0:24118:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1789136140.072669:0:24118:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789136140.072674:0:24118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136140.072676:0:24118:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1789136140.072678:0:24118:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789136140.072681:0:24118:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:3.0:1789136140.072683:0:24118:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789136140.072684:0:24118:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789136140.072686:0:24118:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789136140.072688:0:24118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136140.072689:0:24118:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789136140.072692:0:24118:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789136140.072696:0:24118:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1789136140.072699:0:24118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136140.072700:0:24118:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1789136140.072703:0:24118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789136140.072707:0:24118:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.156@tcp to nid 0x20000c0a8ce9c (192.168.206.156@tcp) 00000020:01000000:3.0:1789136140.072729:0:24118:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1789136140.072731:0:24118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789136140.072742:0:24118:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff94a075499a48) 00000020:00000080:3.0:1789136140.072753:0:24118:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:3.0:1789136140.072758:0:24118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789136140.072810:0:24118:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1789136140.072817:0:24118:0:(osd_handler.c:8895:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789136140.072822:0:24118:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xedd53ca6b6e4725f 00010000:00080000:3.0:1789136140.072861:0:24118:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94a07021d000@lustre-OST0001-osc-MDT0001: add connection 192.168.206.156@tcp at head 00010000:00010000:3.0:1789136140.073056:0:24118:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1789136140.073124:0:24118:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789136140.073137:0:24118:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:0.0:1789136140.073309:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789136140.073314:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789136140.073316:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789136140.073319:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789136140.074197:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a0556dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876044587196160:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1789136140.074264:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876044587196160 offset 0 length 520: 4 00000040:00080000:3.0:1789136140.077079:0:24118:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789136140.077328:0:24118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:3.0:1789136140.077501:0:24118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:2.0:1789136140.082260:0:24126:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1789136140.082269:0:24126:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1789136140.083095:0:24118:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789136140.083108:0:24118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789136140.083145:0:24118:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789136140.083165:0:24118:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xedd53ca6b6e47266 00000100:00080000:2.0:1789136140.083175:0:24118:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789136140.083181:0:24118:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff94a07021d000 using connection 192.168.206.156@tcp/0@lo 00000100:00100000:2.0:1789136140.083212:0:24118:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94a06f1a61c0 x1876044587196288/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789136140.083238:0:24118:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1789136140.083282:0:24118:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789136140.083286:0:24118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789136140.083287:0:24118:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1789136140.083290:0:24118:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789136140.083293:0:24118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789136140.083295:0:24118:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789136140.083297:0:24118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789136140.083299:0:24118:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789136140.083302:0:24118:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789136140.083304:0:24118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789136140.083305:0:24118:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789136140.083315:0:24118:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789136140.083318:0:24118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789136140.083319:0:24118:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789136140.083322:0:24118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1789136140.083344:0:24118:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789136140.083346:0:24118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789136140.083347:0:24118:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789136140.083350:0:24118:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000100:00080000:0.0:1789136140.083555:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789136140.083560:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789136140.083563:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789136140.083566:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789136140.083614:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a06f1a61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876044587196288:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1789136140.083691:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876044587196288 offset 0 length 520: 4 00000020:01000000:2.0:1789136140.083805:0:24114:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:2.0:1789136140.083832:0:24114:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.156@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1789136140.083850:0:24114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a0429a8c00/0xedd53ca6b6e471e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e471ef expref: -99 pid: 24114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136140.083861:0:24114:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.156@tcp lock: ffff94a0429a8c00/0xedd53ca6b6e471e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e471ef expref: -99 pid: 24114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789136140.083869:0:24114:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff949f43b2f800 from 1 10000000:01000000:2.0:1789136140.083871:0:24114:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789136140.083893:0:24114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a0429a9200/0xedd53ca6b6e4726d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136140.083900:0:24114:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.156@tcp lock: ffff94a0429a9200/0xedd53ca6b6e4726d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136140.083911:0:24114:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.156@tcp lock: ffff94a0429a9200/0xedd53ca6b6e4726d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136140.083925:0:24114:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a06f1a5a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24114:1876044587196416:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789136140.083958:0:24114:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136140.084145:0:24114:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a05020d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789136140.087121:0:23373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587196416 00000100:00100000:0.0:1789136140.087136:0:23373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587196416 00000100:00100000:0.0:1789136140.087211:0:23373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789136140.087221:0:23373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0769c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3644072c-bb98-4fbe-9eaf-e40d57d161d0+15:24114:x1876044587196416:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789136140.087238:0:23373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136140.087256:0:23373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94a0413fc200/0xedd53ca6b6e47274 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xedd53ca6b6e4726d expref: -99 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136140.087307:0:23373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94a0413fc200/0xedd53ca6b6e47274 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedd53ca6b6e4726d expref: 16 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136140.087319:0:23373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94a0413fc200/0xedd53ca6b6e47274 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedd53ca6b6e4726d expref: 16 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136140.087329:0:23373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94a0413fc200, rc 0) 00000100:00100000:0.0:1789136140.087424:0:23373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0769c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3644072c-bb98-4fbe-9eaf-e40d57d161d0+16:24114:x1876044587196416:12345-0@lo:101:mount.lustre.0 Request processed in 205us (3464us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136140.087432:0:23373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789136140.087600:0:24114:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a06f1a5a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24114:1876044587196416:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789136140.087651:0:24114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.156@tcp lock: ffff94a0429a9200/0xedd53ca6b6e4726d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e47274 expref: -99 pid: 24114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136140.087661:0:24114:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.156@tcp lock: ffff94a0429a9200/0xedd53ca6b6e4726d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xedd53ca6b6e47274 expref: -99 pid: 24114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136140.088208:0:24114:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a06f1a5a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24114:1876044587196544:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1789136140.088263:0:24114:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136140.088292:0:24114:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a05020d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789136140.088385:0:23371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587196544 00000100:00100000:1.0:1789136140.088390:0:23371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587196544 00000100:00100000:1.0:1789136140.088442:0:23371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789136140.088450:0:23371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0769c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+16:24114:x1876044587196544:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1789136140.088473:0:23371:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1789136140.088489:0:23371:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789136140.088492:0:23371:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:1.0:1789136140.088579:0:23371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0769c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+16:24114:x1876044587196544:12345-0@lo:256:mount.lustre.0 Request processed in 130us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136140.088586:0:23371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789136140.088802:0:24114:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a06f1a5a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24114:1876044587196544:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1789136140.089366:0:24114:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.156@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789136140.089386:0:24114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a0429a9200/0xedd53ca6b6e4726d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e47274 expref: -99 pid: 24114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136140.089571:0:24114:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.156@tcp lock: ffff94a0429a9200/0xedd53ca6b6e4726d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e47274 expref: -99 pid: 24114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789136140.089580:0:24114:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff949f43b2f800 from 1 10000000:01000000:2.0:1789136140.089582:0:24114:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789136140.089607:0:24114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a0429a9800/0xedd53ca6b6e4727b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136140.089615:0:24114:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.156@tcp lock: ffff94a0429a9800/0xedd53ca6b6e4727b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136140.089624:0:24114:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.156@tcp lock: ffff94a0429a9800/0xedd53ca6b6e4727b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136140.089714:0:24114:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a06f1a5a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24114:1876044587196672:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789136140.089801:0:24114:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136140.089902:0:24114:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a05020d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789136140.090114:0:23371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587196672 00000100:00100000:1.0:1789136140.090120:0:23371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587196672 00000100:00100000:1.0:1789136140.090197:0:23371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789136140.090206:0:23371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0769c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+16:24114:x1876044587196672:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789136140.090217:0:23371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789136140.090229:0:23371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94a07a32d200/0xedd53ca6b6e47282 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xedd53ca6b6e4727b expref: -99 pid: 23371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136140.090253:0:23371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94a07a32d200/0xedd53ca6b6e47282 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedd53ca6b6e4727b expref: 17 pid: 23371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136140.090264:0:23371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94a07a32d200/0xedd53ca6b6e47282 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedd53ca6b6e4727b expref: 17 pid: 23371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136140.090273:0:23371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94a07a32d200, rc 0) 00000100:00100000:1.0:1789136140.090317:0:23371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0769c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+17:24114:x1876044587196672:12345-0@lo:101:mount.lustre.0 Request processed in 113us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136140.090325:0:23371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789136140.090413:0:24114:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a06f1a5a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24114:1876044587196672:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789136140.090427:0:24114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.156@tcp lock: ffff94a0429a9800/0xedd53ca6b6e4727b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e47282 expref: -99 pid: 24114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136140.090436:0:24114:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.156@tcp lock: ffff94a0429a9800/0xedd53ca6b6e4727b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xedd53ca6b6e47282 expref: -99 pid: 24114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789136140.091468:0:24114:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 19 count 19 00000040:00080000:2.0:1789136140.091756:0:24114:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789136140.091913:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1789136140.091936:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:2.0:1789136140.091950:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:2.0:1789136140.091966:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:2.0:1789136140.091980:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:2.0:1789136140.091993:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:2.0:1789136140.092006:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:2.0:1789136140.092018:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 144 off9680 00000040:00080000:2.0:1789136140.092032:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9904 00000040:00080000:2.0:1789136140.092047:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10128 00000040:00080000:2.0:1789136140.092060:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 144 off10272 00000040:00080000:2.0:1789136140.092072:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10496 00000040:00080000:2.0:1789136140.092084:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 224 off10720 00000040:00080000:2.0:1789136140.092097:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10848 00000040:00080000:2.0:1789136140.092127:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 224 off11072 00000040:00080000:2.0:1789136140.092142:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 224 off11296 00000040:00080000:2.0:1789136140.092154:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 128 off11424 00000040:00080000:2.0:1789136140.092172:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11648 00000040:00080000:2.0:1789136140.092177:0:24114:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 18 count 19 00000100:00100000:2.0:1789136140.092246:0:24114:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a06f1a5a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24114:1876044587196800:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789136140.092308:0:24114:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136140.092343:0:24114:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a05020d180 going to sleep for 11 seconds 00000100:00100000:1.0:1789136140.092435:0:23371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587196800 00000100:00100000:1.0:1789136140.092442:0:23371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587196800 00000100:00100000:1.0:1789136140.092476:0:23371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789136140.092485:0:23371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0769c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+17:24114:x1876044587196800:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789136140.092597:0:23371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0769c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+17:24114:x1876044587196800:12345-0@lo:501:mount.lustre.0 Request processed in 113us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136140.092603:0:23371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789136140.096831:0:24114:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a06f1a5a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24114:1876044587196800:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789136140.096888:0:24114:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a06f1a5a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24114:1876044587196928:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789136140.096958:0:24114:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136140.096998:0:24114:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a05020d180 going to sleep for 11 seconds 00000100:00100000:1.0:1789136140.097044:0:23371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587196928 00000100:00100000:1.0:1789136140.097050:0:23371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587196928 00000100:00100000:1.0:1789136140.097095:0:23371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789136140.097103:0:23371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0769c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+17:24114:x1876044587196928:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789136140.097217:0:23371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0769c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+17:24114:x1876044587196928:12345-0@lo:503:mount.lustre.0 Request processed in 114us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136140.097226:0:23371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789136140.097310:0:24114:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a06f1a5a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24114:1876044587196928:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789136140.097724:0:24114:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789136140.097796:0:24114:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a0556dc3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24114:1876044587197056:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789136140.097830:0:24114:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136140.097854:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587197056 00000100:00100000:3.0:1789136140.097858:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587197056 00000100:00100000:3.0:1789136140.097881:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789136140.097887:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0769c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+17:24114:x1876044587197056:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789136140.097953:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0769c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+17:24114:x1876044587197056:12345-0@lo:502:mount.lustre.0 Request processed in 65us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136140.097961:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789136140.097989:0:24114:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a042edf6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789136140.098002:0:24114:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a0556dc3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24114:1876044587197056:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789136140.098140:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1789136140.098164:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:3.0:1789136140.098177:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:3.0:1789136140.098190:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:3.0:1789136140.098203:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:3.0:1789136140.098216:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:3.0:1789136140.098231:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:3.0:1789136140.098244:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 144 off9680 00000040:00080000:3.0:1789136140.098258:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9904 00000040:00080000:3.0:1789136140.098271:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10128 00000040:00080000:3.0:1789136140.098285:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 144 off10272 00000040:00080000:3.0:1789136140.098308:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10496 00000040:00080000:3.0:1789136140.098322:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 224 off10720 00000040:00080000:3.0:1789136140.098334:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10848 00000040:00080000:3.0:1789136140.098347:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 224 off11072 00000040:00080000:3.0:1789136140.098358:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 224 off11296 00000040:00080000:3.0:1789136140.098379:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 128 off11424 00000100:00100000:3.0:1789136140.098397:0:24114:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a0556dc3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24114:1876044587197184:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789136140.098438:0:24114:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136140.098459:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587197184 00000100:00100000:3.0:1789136140.098463:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587197184 00000100:00100000:3.0:1789136140.098479:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789136140.098485:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0769c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+17:24114:x1876044587197184:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789136140.098535:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0769c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+17:24114:x1876044587197184:12345-0@lo:502:mount.lustre.0 Request processed in 51us (97us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136140.098542:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789136140.098565:0:24114:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a042edf6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789136140.098575:0:24114:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a0556dc3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24114:1876044587197184:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789136140.098603:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11648 00000040:00080000:3.0:1789136140.098609:0:24114:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 18 count 19 00000020:01000000:3.0:1789136140.104916:0:24128:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789136140.104929:0:24128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136140.104932:0:24128:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789136140.104941:0:24128:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff949f43b2f800 00000020:00000080:3.0:1789136140.104944:0:24128:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789136140.104952:0:24128:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789136140.104954:0:24128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136140.104956:0:24128:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789136140.104958:0:24128:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789136140.104960:0:24128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136140.104973:0:24128:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789136140.104978:0:24128:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff949f43b2f800 00000020:00000080:3.0:1789136140.104980:0:24128:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789136140.105099:0:24128:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789136140.105103:0:24128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136140.105104:0:24128:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789136140.105107:0:24128:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789136140.105109:0:24128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136140.105110:0:24128:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789136140.105114:0:24128:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff949f43b2f800 00000020:00000080:3.0:1789136140.105117:0:24128:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789136140.111161:0:24128:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789136140.111176:0:24128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136140.111178:0:24128:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789136140.111182:0:24128:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789136140.111186:0:24128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136140.111188:0:24128:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789136140.111193:0:24128:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff949f43b2f800 00000020:00000080:3.0:1789136140.111195:0:24128:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789136140.111238:0:24128:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789136140.111243:0:24128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136140.111244:0:24128:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789136140.111247:0:24128:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789136140.111249:0:24128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136140.111251:0:24128:0:(obd_config.c:1563:class_process_config()) marker 6 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789136140.111254:0:24128:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff949f43b2f800 00000020:00000080:3.0:1789136140.111257:0:24128:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789136140.111272:0:24128:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789136140.111274:0:24128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136140.111276:0:24128:0:(obd_config.c:1563:class_process_config()) marker 6 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789136140.111278:0:24128:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789136140.111280:0:24128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136140.111281:0:24128:0:(obd_config.c:1563:class_process_config()) marker 7 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789136140.111290:0:24128:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff949f43b2f800 00000020:00000080:3.0:1789136140.111292:0:24128:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789136140.111326:0:24128:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789136140.111330:0:24128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136140.111331:0:24128:0:(obd_config.c:1563:class_process_config()) marker 7 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789136140.111334:0:24128:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 19 count 19 00000020:01000000:1.0:1789136140.111441:0:24114:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-18 (rc=0) 10000000:01000000:1.0:1789136140.111531:0:24114:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789136140.111555:0:24114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a0429a9800/0xedd53ca6b6e4727b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e47282 expref: -99 pid: 24114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136140.111567:0:24114:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.156@tcp lock: ffff94a0429a9800/0xedd53ca6b6e4727b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e47282 expref: -99 pid: 24114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789136140.111622:0:24114:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789136140.111624:0:24114:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff949f43b2f800 10000000:01000000:1.0:1789136140.111643:0:24114:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff949f43b2f800 10000000:01000000:1.0:1789136140.111648:0:24114:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789136140.111654:0:24114:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff949f43b2f800 from 1 10000000:01000000:1.0:1789136140.111657:0:24114:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789136140.111689:0:24114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a07a32ca00/0xedd53ca6b6e47289 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136140.111697:0:24114:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.156@tcp lock: ffff94a07a32ca00/0xedd53ca6b6e47289 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136140.111713:0:24114:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.156@tcp lock: ffff94a07a32ca00/0xedd53ca6b6e47289 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136140.111737:0:24114:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4416de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24114:1876044587197312:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789136140.111802:0:24114:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136140.111846:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587197312 00000100:00100000:1.0:1789136140.111852:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587197312 00000100:00100000:1.0:1789136140.111890:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789136140.111898:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0769c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+17:24114:x1876044587197312:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789136140.111911:0:23372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789136140.111925:0:23372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94a07a32c400/0xedd53ca6b6e47290 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xedd53ca6b6e47289 expref: -99 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136140.113110:0:23372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94a07a32c400/0xedd53ca6b6e47290 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedd53ca6b6e47289 expref: 18 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136140.113123:0:23372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94a07a32c400/0xedd53ca6b6e47290 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedd53ca6b6e47289 expref: 18 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136140.113608:0:23372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94a07a32c400, rc 0) 00000100:00100000:1.0:1789136140.113696:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0769c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+18:24114:x1876044587197312:12345-0@lo:101:mount.lustre.0 Request processed in 1796us (1892us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136140.113705:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789136140.113768:0:24114:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a081992780 going to sleep for 11 seconds 00000100:00100000:1.0:1789136140.115549:0:24114:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4416de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24114:1876044587197312:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789136140.115582:0:24114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.156@tcp lock: ffff94a07a32ca00/0xedd53ca6b6e47289 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e47290 expref: -99 pid: 24114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136140.115601:0:24114:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.156@tcp lock: ffff94a07a32ca00/0xedd53ca6b6e47289 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xedd53ca6b6e47290 expref: -99 pid: 24114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789136140.127830:0:24114:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:1.0:1789136140.128128:0:24114:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789136140.128316:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:1.0:1789136140.128341:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:1.0:1789136140.128355:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:1.0:1789136140.128369:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:1.0:1789136140.128381:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:1.0:1789136140.129524:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:1.0:1789136140.129552:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:1.0:1789136140.129564:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:1.0:1789136140.129577:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:1.0:1789136140.129589:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:1.0:1789136140.129601:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:1.0:1789136140.129613:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:1.0:1789136140.129625:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:1.0:1789136140.130541:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:1.0:1789136140.130558:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:1.0:1789136140.130571:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:1.0:1789136140.130583:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:1.0:1789136140.130596:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:1.0:1789136140.130607:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:1.0:1789136140.130619:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:1.0:1789136140.130644:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:1.0:1789136140.130742:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:1.0:1789136140.130759:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:1.0:1789136140.130770:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:1.0:1789136140.130780:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:1.0:1789136140.130804:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:1.0:1789136140.130814:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:1.0:1789136140.130824:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:1.0:1789136140.130834:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:1.0:1789136140.130845:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:1.0:1789136140.130855:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:1.0:1789136140.130864:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:1.0:1789136140.130875:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:1.0:1789136140.130885:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:1.0:1789136140.130896:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:1.0:1789136140.130906:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:1.0:1789136140.130915:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:1.0:1789136140.130938:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:1.0:1789136140.130955:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:1.0:1789136140.130968:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:1.0:1789136140.130979:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:1.0:1789136140.130991:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:1.0:1789136140.131005:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:1.0:1789136140.131018:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:1.0:1789136140.131031:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:1.0:1789136140.131044:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:1.0:1789136140.131057:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:1.0:1789136140.131070:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:1.0:1789136140.131210:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:1.0:1789136140.131228:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:1.0:1789136140.131242:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:1.0:1789136140.131247:0:24114:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:1.0:1789136140.131349:0:24114:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4416de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24114:1876044587197440:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789136140.132594:0:24114:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136140.132653:0:24114:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a081992600 going to sleep for 11 seconds 00000100:00100000:1.0:1789136140.132688:0:23373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587197440 00000100:00100000:1.0:1789136140.132695:0:23373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587197440 00000100:00100000:1.0:1789136140.132750:0:23373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789136140.132759:0:23373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0769c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3644072c-bb98-4fbe-9eaf-e40d57d161d0+18:24114:x1876044587197440:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789136140.132892:0:23373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0769c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3644072c-bb98-4fbe-9eaf-e40d57d161d0+18:24114:x1876044587197440:12345-0@lo:501:mount.lustre.0 Request processed in 134us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136140.132899:0:23373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789136140.132948:0:24114:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4416de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24114:1876044587197440:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789136140.132989:0:24114:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4416de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24114:1876044587197568:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789136140.133031:0:24114:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136140.133045:0:24114:0:(client.c:2715:ptlrpc_set_wait()) set ffff949f428fa000 going to sleep for 11 seconds 00000100:00100000:1.0:1789136140.133060:0:23371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587197568 00000100:00100000:1.0:1789136140.133063:0:23371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587197568 00000100:00100000:1.0:1789136140.133084:0:23371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789136140.133089:0:23371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0769c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+18:24114:x1876044587197568:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789136140.133159:0:23371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0769c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+18:24114:x1876044587197568:12345-0@lo:503:mount.lustre.0 Request processed in 69us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136140.133165:0:23371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789136140.133203:0:24114:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4416de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24114:1876044587197568:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789136140.135740:0:24114:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789136140.135841:0:24114:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4416de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24114:1876044587197696:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789136140.135909:0:24114:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136140.135947:0:24114:0:(client.c:2715:ptlrpc_set_wait()) set ffff949f428fa000 going to sleep for 11 seconds 00000100:00100000:2.0:1789136140.136300:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587197696 00000100:00100000:2.0:1789136140.136307:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587197696 00000100:00100000:2.0:1789136140.136354:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789136140.136363:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0769c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+18:24114:x1876044587197696:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789136140.136490:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0769c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+18:24114:x1876044587197696:12345-0@lo:502:mount.lustre.0 Request processed in 127us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136140.136498:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789136140.141604:0:24114:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4416de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24114:1876044587197696:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789136140.141867:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:1.0:1789136140.141899:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:1.0:1789136140.141914:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:1.0:1789136140.141947:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:1.0:1789136140.141962:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:1.0:1789136140.141976:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:1.0:1789136140.141989:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:1.0:1789136140.142002:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:1.0:1789136140.142016:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:1.0:1789136140.142030:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:1.0:1789136140.142043:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:1.0:1789136140.142055:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:1.0:1789136140.142067:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:1.0:1789136140.142078:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:1.0:1789136140.142095:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:1.0:1789136140.142125:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:1.0:1789136140.142141:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:1.0:1789136140.142153:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:1.0:1789136140.142166:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:1.0:1789136140.142179:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:1.0:1789136140.142190:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:1.0:1789136140.142202:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:1.0:1789136140.142215:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:1.0:1789136140.142229:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:1.0:1789136140.142241:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:1.0:1789136140.142254:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:1.0:1789136140.142267:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:1.0:1789136140.142279:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:1.0:1789136140.142290:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:1.0:1789136140.142301:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:1.0:1789136140.142314:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:1.0:1789136140.142339:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:1.0:1789136140.142353:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:1.0:1789136140.142365:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:1.0:1789136140.142378:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:1.0:1789136140.142414:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:1.0:1789136140.142440:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:1.0:1789136140.142454:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:1.0:1789136140.142467:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:1.0:1789136140.142480:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:1.0:1789136140.142492:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:1.0:1789136140.142505:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:1.0:1789136140.142518:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:1.0:1789136140.142532:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:1.0:1789136140.142546:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:1.0:1789136140.142560:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:1.0:1789136140.142571:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:1.0:1789136140.142594:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:1.0:1789136140.142665:0:24114:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4416de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24114:1876044587197824:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789136140.142741:0:24114:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136140.142789:0:23373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587197824 00000100:00100000:1.0:1789136140.142794:0:23373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587197824 00000100:00100000:1.0:1789136140.142833:0:23373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789136140.142841:0:23373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0769c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3644072c-bb98-4fbe-9eaf-e40d57d161d0+18:24114:x1876044587197824:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789136140.142941:0:23373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0769c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3644072c-bb98-4fbe-9eaf-e40d57d161d0+18:24114:x1876044587197824:12345-0@lo:502:mount.lustre.0 Request processed in 100us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136140.142949:0:23373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789136140.143000:0:24114:0:(client.c:2715:ptlrpc_set_wait()) set ffff949f428fa000 going to sleep for 11 seconds 00000100:00100000:1.0:1789136140.143019:0:24114:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4416de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24114:1876044587197824:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789136140.143145:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:1.0:1789136140.143163:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:1.0:1789136140.143181:0:24114:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4416de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24114:1876044587197952:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789136140.143210:0:24114:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136140.143232:0:23371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587197952 00000100:00100000:1.0:1789136140.143240:0:23371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587197952 00000100:00100000:1.0:1789136140.143261:0:23371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789136140.143266:0:23371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0769c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+18:24114:x1876044587197952:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789136140.143317:0:23371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0769c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+18:24114:x1876044587197952:12345-0@lo:502:mount.lustre.0 Request processed in 50us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136140.143323:0:23371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789136140.143349:0:24114:0:(client.c:2715:ptlrpc_set_wait()) set ffff949f428fa000 going to sleep for 11 seconds 00000100:00100000:1.0:1789136140.143360:0:24114:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4416de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24114:1876044587197952:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789136140.143391:0:24114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:1.0:1789136140.143398:0:24114:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1789136140.148171:0:24135:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1789136140.148207:0:24135:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff94a060013490) 00000020:00000080:3.0:1789136140.148231:0:24135:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1789136140.148310:0:24135:0:(tgt_mount.c:153:server_get_mount()) get mount ffff949f43b2f800 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1789136140.148314:0:24135:0:(tgt_mount.c:187:server_put_mount()) put mount ffff949f43b2f800 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1789136140.148317:0:24135:0:(obd_mount.c:710:lustre_put_lsi()) put ffff949f43b2f800 3 00010000:00080000:3.0:1789136140.148348:0:24135:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94a0660f1000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.206.156@tcp at head 00010000:00010000:3.0:1789136140.155132:0:24135:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:3.0:1789136140.155315:0:24135:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1789136140.155356:0:24135:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789136140.155366:0:24135:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xedd53ca6b6e4729e 00000100:00080000:3.0:1789136140.155376:0:24135:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789136140.155381:0:24135:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff94a0660f1000 using connection 192.168.206.156@tcp/0@lo 00000100:00100000:3.0:1789136140.155424:0:24135:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94a0556dc3c0 x1876044587198080/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789136140.155458:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a0556dc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876044587198080:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789136140.155523:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136140.155579:0:23380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587198080 00000100:00100000:3.0:1789136140.155585:0:23380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587198080 00000100:00100000:3.0:1789136140.155612:0:23380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789136140.155618:0:23380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0556de1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1876044587198080:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789136140.157114:0:23380:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 678 last 0 00000020:00000080:3.0:1789136140.157162:0:23380:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xedd53ca6b6e472a5 00000004:00100000:3.0:1789136140.157182:0:23380:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789136140.157220:0:23380:0:(import.c:65:import_set_state_nolock()) ffff94a0660f6000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789136140.157301:0:23380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0556de1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876044587198080:12345-0@lo:38:llog_process_th.0 Request processed in 1680us (1777us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136140.157310:0:23380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789136140.157362:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff94a0556dc3c0 x1876044587198080/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789136150 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136140.157373:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789136140.157380:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1789136140.157387:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1789136140.157391:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789136140.157393:0:3644:0:(import.c:65:import_set_state_nolock()) ffff94a0660f1000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789136140.157399:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a0556dc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876044587198080:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1789136140.157432:0:24135:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789136140.165555:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789136140.165564:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789136140.165566:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789136140.165569:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:0.0:1789136140.167379:0:24135:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:0.0:1789136140.167772:0:24114:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1789136140.167804:0:24114:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789136140.167821:0:24114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a07a32ca00/0xedd53ca6b6e47289 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e47290 expref: -99 pid: 24114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136140.167833:0:24114:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.156@tcp lock: ffff94a07a32ca00/0xedd53ca6b6e47289 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e47290 expref: -99 pid: 24114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789136140.167883:0:24114:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789136140.167885:0:24114:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789136140.167887:0:24114:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789136140.167888:0:24114:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789136140.167890:0:24114:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789136140.167891:0:24114:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789136140.167892:0:24114:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789136140.167894:0:24114:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789136140.167895:0:24114:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789136140.167899:0:24114:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:0.0:1789136140.167901:0:24114:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789136140.167903:0:24114:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789136140.167909:0:24114:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789136140.167910:0:24114:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789136140.167911:0:24114:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789136140.167911:0:24114:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789136140.167912:0:24114:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789136140.167913:0:24114:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789136140.167914:0:24114:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789136140.167938:0:24114:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1789136140.167957:0:24114:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07ad98f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24114:1876044587198208:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789136140.168020:0:24114:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136140.168054:0:24114:0:(client.c:2715:ptlrpc_set_wait()) set ffff949f439779c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789136140.168079:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587198208 00000100:00100000:0.0:1789136140.168085:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587198208 00000100:00100000:0.0:1789136140.168122:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789136140.168130:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0769c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+18:24114:x1876044587198208:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789136140.168156:0:23372:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1789136140.168167:0:23372:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:0.0:1789136140.181574:0:23358:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1789136140.181619:0:23372:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789136140.181661:0:23372:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1789136140.181719:0:23394:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789136140.181724:0:23394:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789136140.181743:0:23394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff94a0413fd400/0xedd53ca6b6e472ac lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136140.181760:0:23394:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff949f4483d800/0xedd53ca6b6e471b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedd53ca6b6e471a9 expref: 18 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136140.181768:0:23394:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94a0413fc200/0xedd53ca6b6e47274 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedd53ca6b6e4726d expref: 18 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136140.181775:0:23394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff94a0413fd400/0xedd53ca6b6e472ac lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136140.181829:0:23394:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94a0413fc200/0xedd53ca6b6e47274 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xedd53ca6b6e4726d expref: 18 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136140.181842:0:23394:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94a0413fc200/0xedd53ca6b6e47274 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xedd53ca6b6e4726d expref: 18 pid: 23373 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136140.181856:0:23394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07ad98780 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23394:1876044587198336:0@lo:104: 00000100:00100000:0.0:1789136140.181914:0:23394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789136140.181957:0:23394:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff949f4483d800/0xedd53ca6b6e471b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xedd53ca6b6e471a9 expref: 18 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136140.181965:0:23394:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff949f4483d800/0xedd53ca6b6e471b0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xedd53ca6b6e471a9 expref: 18 pid: 23373 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136140.181973:0:23394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07ad98000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23394:1876044587198464:0@lo:104: 00000100:00100000:0.0:1789136140.181994:0:23394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136140.182009:0:23394:0:(client.c:2715:ptlrpc_set_wait()) set ffff949f43977d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789136140.182916:0:23362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587198336 00000100:00100000:0.0:1789136140.182926:0:23362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587198336 00000100:00100000:0.0:1789136140.182957:0:23362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587198464 00000100:00100000:0.0:1789136140.182961:0:23362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587198464 00000100:00100000:0.0:1789136140.182976:0:23362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789136140.182985:0:23362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a07ad983c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+4:23394:x1876044587198336:12345-0@lo:104: 00010000:00010000:0.0:1789136140.182998:0:23362:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.156@tcp lock: ffff94a0429a9200/0xedd53ca6b6e4726d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xedd53ca6b6e47274 expref: -99 pid: 24114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136140.183058:0:23362:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789136140.183064:0:23362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a07ad983c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+4:23394:x1876044587198336:12345-0@lo:104: Request processed in 81us (1151us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136140.183080:0:23362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789136140.183097:0:23362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789136140.183103:0:23362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a07ad9a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+3:23394:x1876044587198464:12345-0@lo:104: 00010000:00010000:0.0:1789136140.183110:0:23362:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.156@tcp lock: ffff94a0429a8400/0xedd53ca6b6e471a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xedd53ca6b6e471b0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136140.183145:0:23362:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789136140.183150:0:23362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a07ad9a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+3:23394:x1876044587198464:12345-0@lo:104: Request processed in 47us (1156us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136140.183156:0:23362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789136140.183214:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0769c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+18:24114:x1876044587198208:12345-0@lo:253:mount.lustre.0 Request processed in 15085us (15193us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136140.183221:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789136140.183263:0:23394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07ad98780 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23394:1876044587198336:0@lo:104: 00000100:00100000:0.0:1789136140.183272:0:23394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07ad98000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23394:1876044587198464:0@lo:104: 00010000:00010000:0.0:1789136140.183291:0:23394:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff94a0413fd400/0xedd53ca6b6e472ac lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136140.183308:0:23367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789136140.183313:0:23367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.156@tcp lock: ffff94a0429a9200/0xedd53ca6b6e4726d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xedd53ca6b6e47274 expref: -99 pid: 24114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136140.183320:0:23367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a0429a9200 already unused, calling callback (ffffffffc13c2c20) 10000000:00010000:0.0:1789136140.183324:0:23367:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.156@tcp lock: ffff94a0429a9200/0xedd53ca6b6e4726d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xedd53ca6b6e47274 expref: -99 pid: 24114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136140.183332:0:23367:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.156@tcp lock: ffff94a0429a9200/0xedd53ca6b6e4726d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xedd53ca6b6e47274 expref: -99 pid: 24114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789136140.183345:0:23367:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.156@tcp lock: ffff94a0429a9200/0xedd53ca6b6e4726d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xedd53ca6b6e47274 expref: -99 pid: 24114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789136140.183352:0:23367:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789136140.183383:0:23367:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.156@tcp lock: ffff94a0429a9200/0xedd53ca6b6e4726d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedd53ca6b6e47274 expref: -99 pid: 24114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136140.183389:0:23367:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789136140.183428:0:23367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.156@tcp lock: ffff94a0429a9200/0xedd53ca6b6e4726d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedd53ca6b6e47274 expref: -99 pid: 24114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136140.183434:0:23367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.156@tcp lock: ffff94a0429a9200/0xedd53ca6b6e4726d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedd53ca6b6e47274 expref: -99 pid: 24114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136140.183447:0:23367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789136140.183450:0:23367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.156@tcp lock: ffff94a0429a8400/0xedd53ca6b6e471a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xedd53ca6b6e471b0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136140.183456:0:23367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a0429a8400 already unused, calling callback (ffffffffc13c2c20) 10000000:00010000:0.0:1789136140.183459:0:23367:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.156@tcp lock: ffff94a0429a8400/0xedd53ca6b6e471a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xedd53ca6b6e471b0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136140.183465:0:23367:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.156@tcp lock: ffff94a0429a8400/0xedd53ca6b6e471a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xedd53ca6b6e471b0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789136140.183471:0:23367:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.156@tcp lock: ffff94a0429a8400/0xedd53ca6b6e471a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xedd53ca6b6e471b0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789136140.183475:0:23367:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789136140.183496:0:23367:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.156@tcp lock: ffff94a0429a8400/0xedd53ca6b6e471a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedd53ca6b6e471b0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136140.183501:0:23367:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789136140.183507:0:23367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.156@tcp lock: ffff94a0429a8400/0xedd53ca6b6e471a9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedd53ca6b6e471b0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136140.183512:0:23367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.156@tcp lock: ffff94a0429a8400/0xedd53ca6b6e471a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedd53ca6b6e471b0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136140.183524:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136140.183526:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136140.183527:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789136140.183549:0:24114:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07ad98f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24114:1876044587198208:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789136140.183560:0:24114:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1789136140.183563:0:24114:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789136140.183564:0:24114:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789136140.183566:0:24114:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789136140.183567:0:24114:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789136140.183568:0:24114:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789136140.183569:0:24114:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789136140.183571:0:24114:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789136140.183572:0:24114:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789136140.183574:0:24114:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789136140.183584:0:24114:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1789136140.183900:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136140.184717:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07ad98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3644072c-bb98-4fbe-9eaf-e40d57d161d0:3647:1876044587198592:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789136140.184781:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136140.184820:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789136140.184827:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07ad98780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3644072c-bb98-4fbe-9eaf-e40d57d161d0:3647:1876044587198720:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789136140.184850:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136140.184905:0:23363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587198592 00000100:00100000:1.0:1789136140.184912:0:23363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587198592 00010000:00010000:1.0:1789136140.184944:0:23363:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94a0413fc200/0xedd53ca6b6e47274 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedd53ca6b6e4726d expref: 18 pid: 23373 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136140.184971:0:23363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587198720 00000100:00100000:1.0:1789136140.184974:0:23363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587198720 00010000:00010000:1.0:1789136140.184985:0:23363:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff949f4483d800/0xedd53ca6b6e471b0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedd53ca6b6e471a9 expref: 19 pid: 23373 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136140.185000:0:23363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789136140.185008:0:23363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0556dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+19:3647:x1876044587198592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789136140.185021:0:23363:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789136140.185026:0:23363:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94a0413fc200/0xedd53ca6b6e47274 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedd53ca6b6e4726d expref: 19 pid: 23373 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136140.185036:0:23363:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94a0413fc200/0xedd53ca6b6e47274 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xedd53ca6b6e4726d expref: 19 pid: 23373 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136140.185071:0:23363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94a0413fc200/0xedd53ca6b6e47274 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xedd53ca6b6e4726d expref: 19 pid: 23373 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136140.185085:0:23363:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789136140.185131:0:23363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0556dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+18:3647:x1876044587198592:12345-0@lo:103:ldlm_bl.0 Request processed in 123us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136140.185138:0:23363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789136140.185155:0:23363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789136140.185161:0:23363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0556dc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+17:3647:x1876044587198720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789136140.185168:0:23363:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789136140.185171:0:23363:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff949f4483d800/0xedd53ca6b6e471b0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedd53ca6b6e471a9 expref: 17 pid: 23373 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136140.185180:0:23363:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff949f4483d800/0xedd53ca6b6e471b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xedd53ca6b6e471a9 expref: 17 pid: 23373 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136140.185190:0:23363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff949f4483d800/0xedd53ca6b6e471b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xedd53ca6b6e471a9 expref: 17 pid: 23373 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136140.185201:0:23363:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff94a0413fd400/0xedd53ca6b6e472ac lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136140.185209:0:23363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94a0413fd400/0xedd53ca6b6e472ac lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789136140.185224:0:23363:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.013081833s 00010000:00010000:1.0:1789136140.185228:0:23363:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94a0413fd400/0xedd53ca6b6e472ac lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136140.185244:0:23363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94a0413fd400/0xedd53ca6b6e472ac lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136140.185251:0:23363:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff94a0413fd400/0xedd53ca6b6e472ac lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136140.185258:0:23363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff94a0413fd400/0xedd53ca6b6e472ac lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136140.185264:0:23363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a0413fd400 already unused, calling callback (ffffffffc0d90550) 00010000:00010000:1.0:1789136140.185268:0:23363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff94a0413fd400/0xedd53ca6b6e472ac lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136140.185276:0:23363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff94a0413fd400/0xedd53ca6b6e472ac lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136140.185290:0:23363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff94a0413fd400/0xedd53ca6b6e472ac lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136140.185300:0:23363:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789136140.185324:0:23363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0556dc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+16:3647:x1876044587198720:12345-0@lo:103:ldlm_bl.0 Request processed in 163us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136140.185330:0:23363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789136140.185416:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07ad98780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3644072c-bb98-4fbe-9eaf-e40d57d161d0:3647:1876044587198720:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789136140.185433:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07ad98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3644072c-bb98-4fbe-9eaf-e40d57d161d0:3647:1876044587198592:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789136140.185691:0:23394:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff94a0413fd400/0xedd53ca6b6e472ac lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136140.185700:0:23394:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff94a0413fd400/0xedd53ca6b6e472ac lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136140.185706:0:23394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94a0413fd400/0xedd53ca6b6e472ac lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:1.0:1789136140.199051:0:24114:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:0.0:1789136140.199724:0:24142:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1789136140.199730:0:24142:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:1.0:1789136140.200237:0:24143:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789136140.200257:0:24114:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:1.0:1789136140.200746:0:24143:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789136140.203891:0:24143:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789136140.203952:0:24143:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:0.0:1789136140.207972:0:24144:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07ad98f00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:24144:1876044587198848:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789136140.208046:0:24144:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136140.208080:0:24144:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a05075c540 going to sleep for 11 seconds 00000040:01000000:1.0:1789136140.208230:0:24114:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1789136140.208268:0:24114:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1789136140.209034:0:24114:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1789136140.209046:0:24114:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1789136140.209094:0:24114:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789136140.211343:0:24114:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1789136140.212204:0:24114:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1789136140.212246:0:24114:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:1.0:1789136140.212356:0:24114:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1789136140.213132:0:24114:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000100:00100000:2.0:1789136140.216833:0:23384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587198848 00000100:00100000:2.0:1789136140.216848:0:23384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587198848 00000100:00100000:2.0:1789136140.216936:0:23384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789136140.216947:0:23384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a07ad9bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:24144:x1876044587198848:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1789136140.217192:0:23384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a07ad9bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:24144:x1876044587198848:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 247us (9146us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136140.217200:0:23384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789136140.217519:0:24144:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07ad98f00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:24144:1876044587198848:0@lo:1000:lod0001_rec0000.0 00000040:01000000:0.0:1789136140.217564:0:24144:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1789136140.217609:0:24144:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07ad98f00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:24144:1876044587198976:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789136140.217690:0:24144:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136140.217716:0:24144:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a05075c540 going to sleep for 11 seconds 00000001:00000004:1.0:1789136140.219197:0:24114:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:3.0:1789136140.219391:0:24123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587198976 00000100:00100000:3.0:1789136140.219415:0:24123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587198976 00000100:00100000:3.0:1789136140.219459:0:24123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789136140.219468:0:24123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a07ad99a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:24144:x1876044587198976:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1789136140.219608:0:24123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a07ad99a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:24144:x1876044587198976:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 141us (1918us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136140.219615:0:24123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789136140.219833:0:24144:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07ad98f00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:24144:1876044587198976:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789136140.219909:0:24144:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07ad98f00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:24144:1876044587199104:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1789136140.219946:0:24144:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136140.219972:0:24144:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a05075cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789136140.220065:0:23389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587199104 00000100:00100000:3.0:1789136140.220070:0:23389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587199104 00000100:00100000:3.0:1789136140.220103:0:23389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789136140.220110:0:23389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a07ad99e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:24144:x1876044587199104:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1789136140.220181:0:23389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a07ad99e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:24144:x1876044587199104:12345-0@lo:900:lod0001_rec0000.0 Request processed in 72us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136140.220188:0:23389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789136140.220270:0:24144:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff94a07ad98f00 x1876044587199104/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789136156 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136140.220281:0:24144:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07ad98f00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:24144:1876044587199104:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1789136140.220328:0:24144:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4416de00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:24144:1876044587199232:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789136140.220360:0:24144:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136140.220485:0:24144:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a043000600 going to sleep for 11 seconds 00000100:00100000:0.0:1789136140.229765:0:23383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587199232 00000100:00100000:0.0:1789136140.229780:0:23383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587199232 00000100:00100000:2.0:1789136140.232842:0:23383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789136140.232854:0:23383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f4416f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:24144:x1876044587199232:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1789136140.232961:0:23383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f4416f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:24144:x1876044587199232:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 110us (12600us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136140.232969:0:23383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000001:00080000:3.0:1789136140.233315:0:24114:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789136140.233345:0:24114:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb368c556f988 00100000:10000000:3.0:1789136140.233352:0:24114:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000100:00100000:1.0:1789136140.233538:0:24144:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4416de00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:24144:1876044587199232:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1789136140.233596:0:24144:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:01000004:2.0:1789136140.237400:0:24114:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789136140.237441:0:24114:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.156@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789136140.237459:0:24114:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1789136140.237483:0:24114:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1789136140.238093:0:24114:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000040:00080000:1.0:1789136140.239009:0:24144:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789136140.239072:0:24144:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1789136140.239083:0:24144:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000020:00000004:2.0:1789136140.242507:0:24114:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789136140.593775:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136141.041692:0:23422:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a0483173c0 going to sleep for 0 seconds 00000040:00080000:0.0:1789136141.171221:0:24136:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789136141.627760:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789136142.067662:0:23422:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a0483173c0 going to sleep for 0 seconds 10000000:01000000:3.0:1789136142.195712:0:23375:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789136142.195725:0:23375:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff949f43b2f800 from 12 10000000:01000000:3.0:1789136142.195733:0:23375:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789136142.195825:0:23375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.156@tcp lock: ffff949f4483c400/0xedd53ca6b6e472b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136142.195839:0:23375:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.156@tcp lock: ffff949f4483c400/0xedd53ca6b6e472b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136142.195877:0:23375:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.156@tcp lock: ffff949f4483c400/0xedd53ca6b6e472b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136142.195912:0:23375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a0556dfc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23375:1876044587199360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789136142.196023:0:23375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136142.196082:0:23375:0:(client.c:2715:ptlrpc_set_wait()) set ffff949f43435180 going to sleep for 11 seconds 00000100:00100000:2.0:1789136142.196262:0:23373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587199360 00000100:00100000:2.0:1789136142.196273:0:23373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587199360 00000100:00100000:2.0:1789136142.196346:0:23373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789136142.196359:0:23373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0769c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3644072c-bb98-4fbe-9eaf-e40d57d161d0+16:23375:x1876044587199360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789136142.196377:0:23373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789136142.196414:0:23373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94a0429a8000/0xedd53ca6b6e472ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xedd53ca6b6e472b3 expref: -99 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136142.196445:0:23373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94a0429a8000/0xedd53ca6b6e472ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedd53ca6b6e472b3 expref: 17 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136142.196457:0:23373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94a0429a8000/0xedd53ca6b6e472ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedd53ca6b6e472b3 expref: 17 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136142.196468:0:23373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94a0429a8000, rc 0) 00000100:00100000:2.0:1789136142.196517:0:23373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0769c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3644072c-bb98-4fbe-9eaf-e40d57d161d0+17:23375:x1876044587199360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136142.196525:0:23373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789136142.197303:0:23375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a0556dfc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23375:1876044587199360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789136142.197330:0:23375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.156@tcp lock: ffff949f4483c400/0xedd53ca6b6e472b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e472ba expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136142.197343:0:23375:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.156@tcp lock: ffff949f4483c400/0xedd53ca6b6e472b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xedd53ca6b6e472ba expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136142.197450:0:23375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a0556dfc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23375:1876044587199488:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789136142.197507:0:23375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136142.197541:0:23375:0:(client.c:2715:ptlrpc_set_wait()) set ffff949f43435180 going to sleep for 11 seconds 00000100:00100000:2.0:1789136142.197724:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587199488 00000100:00100000:2.0:1789136142.197731:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587199488 00000100:00100000:2.0:1789136142.197784:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789136142.197795:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a045424c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+17:23375:x1876044587199488:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789136142.197816:0:23372:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789136142.197837:0:23372:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789136142.197845:0:23372:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:2.0:1789136142.197937:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a045424c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+17:23375:x1876044587199488:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 143us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136142.197945:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789136142.198404:0:23375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a0556dfc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23375:1876044587199488:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789136142.198460:0:23375:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.156@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789136142.198470:0:23375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.156@tcp lock: ffff949f4483c400/0xedd53ca6b6e472b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e472ba expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136142.198481:0:23375:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.156@tcp lock: ffff949f4483c400/0xedd53ca6b6e472b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e472ba expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789136142.198492:0:23375:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789136142.198496:0:23375:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff949f449ce800 from 12 10000000:01000000:3.0:1789136142.198505:0:23375:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789136142.198534:0:23375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.156@tcp lock: ffff949f4483c800/0xedd53ca6b6e472c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136142.198541:0:23375:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.156@tcp lock: ffff949f4483c800/0xedd53ca6b6e472c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136142.198552:0:23375:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.156@tcp lock: ffff949f4483c800/0xedd53ca6b6e472c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136142.198569:0:23375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a0556dfc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23375:1876044587199616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789136142.198606:0:23375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136142.198653:0:23375:0:(client.c:2715:ptlrpc_set_wait()) set ffff949f43435180 going to sleep for 11 seconds 00000100:00100000:1.0:1789136142.199042:0:23371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587199616 00000100:00100000:1.0:1789136142.199050:0:23371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587199616 00000100:00100000:1.0:1789136142.199094:0:23371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789136142.199104:0:23371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a045426050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+17:23375:x1876044587199616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789136142.199118:0:23371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789136142.199135:0:23371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94a07a32c600/0xedd53ca6b6e472c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xedd53ca6b6e472c1 expref: -99 pid: 23371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136142.199164:0:23371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94a07a32c600/0xedd53ca6b6e472c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedd53ca6b6e472c1 expref: 18 pid: 23371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136142.199176:0:23371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94a07a32c600/0xedd53ca6b6e472c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedd53ca6b6e472c1 expref: 18 pid: 23371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136142.199186:0:23371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94a07a32c600, rc 0) 00000100:00100000:1.0:1789136142.199231:0:23371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a045426050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+18:23375:x1876044587199616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136142.199919:0:23371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789136142.200973:0:23375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a0556dfc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23375:1876044587199616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789136142.201006:0:23375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.156@tcp lock: ffff949f4483c800/0xedd53ca6b6e472c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e472c8 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136142.201020:0:23375:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.156@tcp lock: ffff949f4483c800/0xedd53ca6b6e472c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xedd53ca6b6e472c8 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136142.201119:0:23375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a0556dfc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23375:1876044587199744:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789136142.201191:0:23375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136142.201238:0:23375:0:(client.c:2715:ptlrpc_set_wait()) set ffff949f43435180 going to sleep for 11 seconds 00000100:00100000:1.0:1789136142.202918:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587199744 00000100:00100000:1.0:1789136142.202940:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587199744 00000100:00100000:1.0:1789136142.203023:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789136142.203051:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a045427850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+18:23375:x1876044587199744:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789136142.203088:0:23372:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789136142.203112:0:23372:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789136142.203116:0:23372:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:1.0:1789136142.203277:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a045427850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+18:23375:x1876044587199744:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 229us (2085us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136142.203292:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789136142.203388:0:23375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a0556dfc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23375:1876044587199744:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789136142.203463:0:23375:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.156@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789136142.203475:0:23375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.156@tcp lock: ffff949f4483c800/0xedd53ca6b6e472c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e472c8 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136142.203487:0:23375:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.156@tcp lock: ffff949f4483c800/0xedd53ca6b6e472c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e472c8 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789136142.204402:0:24136:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789136142.640947:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789136143.088697:0:23422:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a0483173c0 going to sleep for 0 seconds 00010000:00010000:3.0:1789136143.670433:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789136144.114009:0:23422:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a0483173c0 going to sleep for 0 seconds 00010000:00010000:3.0:1789136144.699154:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789136145.051584:0:24389:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg656-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1789136145.136703:0:23422:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a0483173c0 going to sleep for 0 seconds 00000100:00080000:3.0:1789136145.392988:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00100000:1.0:1789136145.392994:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:3.0:1789136145.393003:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1789136145.393007:0:37:0:(import.c:65:import_set_state_nolock()) ffff94a076549800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1789136145.393017:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a0556dcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3644072c-bb98-4fbe-9eaf-e40d57d161d0:3646:1876044587199872:0@lo:400:kworker.0 00000100:00080000:3.0:1789136145.393030:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff94a076549800 using connection 192.168.206.156@tcp/0@lo 00000100:00100000:3.0:1789136145.393055:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94a0556df840 x1876044587200000/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789136145.393074:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789136145.393078:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789136145.393080:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789136145.393084:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789136145.393091:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789136145.393113:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789136145.393129:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789136145.393132:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:1.0:1789136145.393136:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a0556dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876044587200128:0@lo:400:kworker.0 00000100:00080000:3.0:1789136145.393137:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789136145.393168:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136145.393172:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a0556df840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876044587200000:0@lo:38:kworker.0 00000100:00100000:1.0:1789136145.393201:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587199872 00000100:00100000:1.0:1789136145.393208:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587199872 00000100:00100000:3.0:1789136145.393220:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136145.393253:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789136145.393262:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a0556de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876044587200256:0@lo:400:kworker.0 00000100:00100000:1.0:1789136145.393264:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a045427050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+18:3646:x1876044587199872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136145.393292:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136145.393313:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789136145.393320:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a0556dfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876044587200384:0@lo:400:kworker.0 00000100:00100000:1.0:1789136145.393326:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a045427050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+18:3646:x1876044587199872:12345-0@lo:400:kworker.0 Request processed in 61us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136145.393335:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789136145.393348:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136145.393390:0:23378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587200128 00000100:00100000:1.0:1789136145.393395:0:23378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587200128 00000100:00100000:3.0:1789136145.393401:0:23384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587200000 00000100:00100000:3.0:1789136145.393407:0:23384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587200000 00000100:00100000:2.0:1789136145.393423:0:23383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587200256 00000100:00100000:3.0:1789136145.393435:0:23384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789136145.393438:0:23378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587200384 00000100:00100000:2.0:1789136145.393441:0:23383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587200256 00000100:00100000:1.0:1789136145.393443:0:23378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587200384 00000100:00100000:3.0:1789136145.393454:0:23384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a043738f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1876044587200000:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1789136145.393470:0:23378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789136145.393478:0:23384:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 683 last 0 00000100:00100000:1.0:1789136145.393482:0:23378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f4416fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876044587200128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136145.393483:0:23383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789136145.393498:0:23383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a04373a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876044587200256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136145.393533:0:23378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f4416fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876044587200128:12345-0@lo:400:kworker.0 Request processed in 56us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136145.393541:0:23378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789136145.393559:0:23378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789136145.393561:0:23383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a04373a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876044587200256:12345-0@lo:400:kworker.0 Request processed in 63us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136145.393569:0:23378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0437392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876044587200384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136145.393570:0:23383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000020:00000080:3.0:1789136145.393585:0:23384:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xedd53ca6b6e472cf 00000004:00100000:3.0:1789136145.393602:0:23384:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1789136145.393608:0:23384:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:2.0:1789136145.393616:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a0556de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876044587200256:0@lo:400:kworker.0 00000100:00100000:1.0:1789136145.395366:0:23378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0437392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876044587200384:12345-0@lo:400:kworker.0 Request processed in 1792us (2010us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136145.395389:0:23378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789136145.395463:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94a0556dd680 x1876044587200128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136145.395478:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a0556dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876044587200128:0@lo:400:kworker.0 00000100:00100000:1.0:1789136145.395492:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a0556dcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3644072c-bb98-4fbe-9eaf-e40d57d161d0:3646:1876044587199872:0@lo:400:kworker.0 00010000:00080000:2.0:1789136145.395533:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94a0556dfc00 x1876044587200384/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789136145.395545:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a0556dfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876044587200384:0@lo:400:kworker.0 00000100:00100000:3.0:1789136145.396808:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789136145.396825:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a0437383c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876044587200512:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789136145.396889:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136145.397182:0:23383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587200512 00000100:00100000:2.0:1789136145.397190:0:23383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587200512 00000100:00100000:2.0:1789136145.397243:0:23383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789136145.397251:0:23383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a04373a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876044587200512:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789136145.397283:0:23383:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789136145.397339:0:23383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a04373a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876044587200512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136145.397346:0:23383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789136145.397596:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a0437383c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876044587200512:0@lo:41:osp-pre-0-1.0 00000100:00080000:0.0:1789136145.404841:0:23384:0:(import.c:65:import_set_state_nolock()) ffff94a08185c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789136145.404933:0:23384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a043738f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1876044587200000:12345-0@lo:38:kworker.0 Request processed in 11478us (11712us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136145.404944:0:23384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1789136145.405185:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1789136145.405195:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1789136145.405200:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1789136145.405203:0:3644:0:(import.c:65:import_set_state_nolock()) ffff94a076549800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1789136145.405229:0:3644:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000005d960b71): req@ffff94a06f1a5e00 x1876044587193088/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136145.405250:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a0556df840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876044587200000:0@lo:38:kworker.0 00000100:00100000:3.0:1789136145.405321:0:23422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136145.405351:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789136145.405382:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a06f1a4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876044587200640:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789136145.405741:0:23422:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a0483173c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789136145.405813:0:23383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587193088 00000100:00100000:0.0:1789136145.405820:0:23383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587193088 00000100:00100000:0.0:1789136145.405857:0:23383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789136145.405866:0:23383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a04373ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:23422:x1876044587193088:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1789136145.405937:0:23383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a04373ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:23422:x1876044587193088:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 72us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136145.405945:0:23383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789136145.406181:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136145.406458:0:23384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587200640 00000100:00100000:0.0:1789136145.406463:0:23384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587200640 00000100:00100000:0.0:1789136145.406506:0:23384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789136145.406513:0:23384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a06f1a4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3645:x1876044587200640:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789136145.406537:0:23384:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789136145.406579:0:23384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a06f1a4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3645:x1876044587200640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 67us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136145.406585:0:23384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789136145.406680:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a06f1a4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876044587200640:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789136145.406742:0:23422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a06f1a5e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:23422:1876044587193088:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1789136145.406773:0:23422:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1789136145.406807:0:23422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a043738780 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:23422:1876044587200768:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789136145.406838:0:23422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136145.406861:0:23422:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a0512f1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789136145.407240:0:23384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587200768 00000100:00100000:0.0:1789136145.407245:0:23384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587200768 00000100:00100000:0.0:1789136145.407278:0:23384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789136145.407286:0:23384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a04373b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:23422:x1876044587200768:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1789136145.407576:0:23384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a04373b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:23422:x1876044587200768:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 291us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136145.407583:0:23384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789136145.407731:0:23422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a043738780 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:23422:1876044587200768:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789136145.407803:0:23422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a043738780 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:23422:1876044587200896:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789136145.407831:0:23422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136145.407857:0:23422:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a0512f1000 going to sleep for 11 seconds 00000100:00100000:0.0:1789136145.408204:0:24123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587200896 00000100:00100000:0.0:1789136145.408210:0:24123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587200896 00000100:00100000:0.0:1789136145.408254:0:24123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789136145.408261:0:24123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a043739e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:23422:x1876044587200896:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1789136145.408329:0:24123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a043739e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:23422:x1876044587200896:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 68us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136145.408335:0:24123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789136145.408925:0:23422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a043738780 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:23422:1876044587200896:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1789136145.408975:0:23422:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789136145.412514:0:23422:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789136145.412605:0:23422:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 19, retries 0 00000004:00080000:3.0:1789136145.412610:0:23422:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1789136145.713976:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789136145.802043:0:24441:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789136145.802253:0:24441:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:3.0:1789136146.714933:0:24491:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789136146.715195:0:24491:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789136146.741457:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789136147.694809:0:24539:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff69242790 20000000:00000080:3.0:1789136147.694826:0:24539:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff94a0601ec400 uarg=0000000000000000 20000000:01000000:3.0:1789136147.694866:0:24539:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1789136147.694872:0:24539:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1789136147.694877:0:24539:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1789136147.696050:0:24540:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 19 20000000:00000400:2.0:1789136147.696244:0:24539:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789136147.706246:0:24539:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789136147.706276:0:24539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff94a0429a8400/0xedd53ca6b6e472d6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136147.706295:0:24539:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94a0413fce00/0xedd53ca6b6e4717f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedd53ca6b6e47178 expref: 17 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136147.706303:0:24539:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94a07a32d200/0xedd53ca6b6e47282 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedd53ca6b6e4727b expref: 17 pid: 23371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136147.706312:0:24539:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff94a0429a8400/0xedd53ca6b6e472d6 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 24539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136147.707876:0:24539:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94a07a32d200/0xedd53ca6b6e47282 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xedd53ca6b6e4727b expref: 17 pid: 23371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136147.707897:0:24539:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94a07a32d200/0xedd53ca6b6e47282 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xedd53ca6b6e4727b expref: 17 pid: 23371 timeout: 785 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136147.707912:0:24539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a06f1a5680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24539:1876044587201024:0@lo:104: 00000100:00100000:2.0:1789136147.707975:0:24539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789136147.708023:0:24539:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94a0413fce00/0xedd53ca6b6e4717f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xedd53ca6b6e47178 expref: 17 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136147.708031:0:24539:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94a0413fce00/0xedd53ca6b6e4717f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xedd53ca6b6e47178 expref: 17 pid: 23372 timeout: 785 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136147.708057:0:24539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a06f1a43c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24539:1876044587201152:0@lo:104: 00000100:00100000:2.0:1789136147.708079:0:24539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136147.708107:0:24539:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a0456399c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789136147.708376:0:23361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587201024 00000100:00100000:0.0:1789136147.708382:0:23361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587201024 00000100:00100000:0.0:1789136147.708419:0:23361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587201152 00000100:00100000:0.0:1789136147.708421:0:23361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587201152 00000100:00100000:0.0:1789136147.708434:0:23361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789136147.708441:0:23361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a06f1a7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+4:24539:x1876044587201024:12345-0@lo:104: 00010000:00010000:0.0:1789136147.708454:0:23361:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.156@tcp lock: ffff94a0429a9800/0xedd53ca6b6e4727b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xedd53ca6b6e47282 expref: -99 pid: 24114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136147.708520:0:23361:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789136147.708526:0:23361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a06f1a7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+4:24539:x1876044587201024:12345-0@lo:104: Request processed in 85us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136147.708533:0:23361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789136147.708549:0:23361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789136147.708555:0:23361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a06f1a4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+3:24539:x1876044587201152:12345-0@lo:104: 00010000:00010000:0.0:1789136147.708562:0:23361:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.156@tcp lock: ffff949f4483d200/0xedd53ca6b6e47178 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xedd53ca6b6e4717f expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136147.708593:0:23361:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789136147.708598:0:23361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a06f1a4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+3:24539:x1876044587201152:12345-0@lo:104: Request processed in 43us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136147.708603:0:23361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1789136147.708759:0:23366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789136147.708767:0:23366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.156@tcp lock: ffff94a0429a9800/0xedd53ca6b6e4727b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xedd53ca6b6e47282 expref: -99 pid: 24114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136147.708775:0:23366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a0429a9800 already unused, calling callback (ffffffffc13c2c20) 10000000:00010000:3.0:1789136147.708779:0:23366:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.156@tcp lock: ffff94a0429a9800/0xedd53ca6b6e4727b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xedd53ca6b6e47282 expref: -99 pid: 24114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136147.708788:0:23366:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.156@tcp lock: ffff94a0429a9800/0xedd53ca6b6e4727b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xedd53ca6b6e47282 expref: -99 pid: 24114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789136147.708796:0:23366:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.156@tcp lock: ffff94a0429a9800/0xedd53ca6b6e4727b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xedd53ca6b6e47282 expref: -99 pid: 24114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789136147.708801:0:23366:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789136147.708829:0:23366:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.156@tcp lock: ffff94a0429a9800/0xedd53ca6b6e4727b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedd53ca6b6e47282 expref: -99 pid: 24114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136147.708842:0:23366:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789136147.708863:0:23366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.156@tcp lock: ffff94a0429a9800/0xedd53ca6b6e4727b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedd53ca6b6e47282 expref: -99 pid: 24114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136147.708870:0:23366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.156@tcp lock: ffff94a0429a9800/0xedd53ca6b6e4727b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedd53ca6b6e47282 expref: -99 pid: 24114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136147.708884:0:23366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789136147.708887:0:23366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.156@tcp lock: ffff949f4483d200/0xedd53ca6b6e47178 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xedd53ca6b6e4717f expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136147.708892:0:23366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff949f4483d200 already unused, calling callback (ffffffffc13c2c20) 10000000:00010000:3.0:1789136147.708895:0:23366:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.156@tcp lock: ffff949f4483d200/0xedd53ca6b6e47178 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xedd53ca6b6e4717f expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136147.708901:0:23366:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.156@tcp lock: ffff949f4483d200/0xedd53ca6b6e47178 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xedd53ca6b6e4717f expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789136147.708907:0:23366:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.156@tcp lock: ffff949f4483d200/0xedd53ca6b6e47178 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xedd53ca6b6e4717f expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789136147.708912:0:23366:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789136147.708926:0:23366:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.156@tcp lock: ffff949f4483d200/0xedd53ca6b6e47178 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedd53ca6b6e4717f expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136147.708932:0:23366:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789136147.708937:0:23366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.156@tcp lock: ffff949f4483d200/0xedd53ca6b6e47178 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedd53ca6b6e4717f expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136147.708943:0:23366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.156@tcp lock: ffff949f4483d200/0xedd53ca6b6e47178 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedd53ca6b6e4717f expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136147.708964:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136147.708966:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136147.708967:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136147.708974:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136147.708985:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a04373bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3644072c-bb98-4fbe-9eaf-e40d57d161d0:3647:1876044587201280:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789136147.709017:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136147.709046:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789136147.709051:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a043738b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3644072c-bb98-4fbe-9eaf-e40d57d161d0:3647:1876044587201408:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789136147.709070:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136147.709108:0:23364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587201280 00000100:00100000:3.0:1789136147.709112:0:23364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587201280 00010000:00010000:3.0:1789136147.709131:0:23364:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94a07a32d200/0xedd53ca6b6e47282 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedd53ca6b6e4727b expref: 18 pid: 23371 timeout: 785 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136147.709150:0:23364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587201408 00000100:00100000:3.0:1789136147.709153:0:23364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587201408 00010000:00010000:3.0:1789136147.709163:0:23364:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94a0413fce00/0xedd53ca6b6e4717f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedd53ca6b6e47178 expref: 19 pid: 23372 timeout: 785 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136147.709175:0:23364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789136147.709181:0:23364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a043739680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+19:3647:x1876044587201280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789136147.709190:0:23364:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789136147.709195:0:23364:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94a07a32d200/0xedd53ca6b6e47282 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedd53ca6b6e4727b expref: 19 pid: 23371 timeout: 785 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136147.709205:0:23364:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94a07a32d200/0xedd53ca6b6e47282 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xedd53ca6b6e4727b expref: 19 pid: 23371 timeout: 785 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136147.709230:0:23364:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789136147.709256:0:23364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a043739680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+19:3647:x1876044587201280:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136147.709262:0:23364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789136147.709275:0:23364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789136147.709281:0:23364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a04373b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+18:3647:x1876044587201408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789136147.709288:0:23364:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789136147.709292:0:23364:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94a0413fce00/0xedd53ca6b6e4717f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedd53ca6b6e47178 expref: 18 pid: 23372 timeout: 785 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136147.709300:0:23364:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94a0413fce00/0xedd53ca6b6e4717f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xedd53ca6b6e47178 expref: 18 pid: 23372 timeout: 785 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136147.709312:0:23364:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff94a0429a8400/0xedd53ca6b6e472d6 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 24539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136147.709320:0:23364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94a0429a8400/0xedd53ca6b6e472d6 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 24539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136147.709334:0:23364:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94a0429a8400/0xedd53ca6b6e472d6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 24539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136147.709341:0:23364:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94a0429a8400/0xedd53ca6b6e472d6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 24539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136147.709347:0:23364:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff94a0429a8400/0xedd53ca6b6e472d6 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 24539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136147.709373:0:23364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff94a0429a8400/0xedd53ca6b6e472d6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 24539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136147.709386:0:23364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a0429a8400 already unused, calling callback (ffffffffc0d90550) 00010000:00010000:3.0:1789136147.709389:0:23364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff94a0429a8400/0xedd53ca6b6e472d6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 24539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136147.709397:0:23364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff94a0429a8400/0xedd53ca6b6e472d6 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 24539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136147.709405:0:23364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff94a0429a8400/0xedd53ca6b6e472d6 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136147.709414:0:23364:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789136147.709438:0:23364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a04373b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+18:3647:x1876044587201408:12345-0@lo:103:ldlm_bl.0 Request processed in 157us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136147.709445:0:23364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789136147.709532:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a043738b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3644072c-bb98-4fbe-9eaf-e40d57d161d0:3647:1876044587201408:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789136147.709541:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a04373bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3644072c-bb98-4fbe-9eaf-e40d57d161d0:3647:1876044587201280:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789136147.710064:0:24539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94a07a32d200/0xedd53ca6b6e47282 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xedd53ca6b6e4727b expref: 17 pid: 23371 timeout: 785 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136147.710077:0:24539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a06f1a5680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24539:1876044587201024:0@lo:104: 00010000:00010000:2.0:1789136147.710087:0:24539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94a0413fce00/0xedd53ca6b6e4717f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xedd53ca6b6e47178 expref: 16 pid: 23372 timeout: 785 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136147.710096:0:24539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a06f1a43c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24539:1876044587201152:0@lo:104: 00010000:00010000:2.0:1789136147.710112:0:24539:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff94a0429a8400/0xedd53ca6b6e472d6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136147.710120:0:24539:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff94a0429a8400/0xedd53ca6b6e472d6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136147.710126:0:24539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff94a0429a8400/0xedd53ca6b6e472d6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136147.710131:0:24539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94a0429a8400/0xedd53ca6b6e472d6 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136147.764101:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789136148.145703:0:23417:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789136148.785951:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789136148.920087:0:23375:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789136148.920099:0:23375:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff949f43b2f800 from 19 10000000:01000000:1.0:1789136148.920106:0:23375:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789136148.920167:0:23375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a07a32d600/0xedd53ca6b6e472dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136148.920180:0:23375:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.156@tcp lock: ffff94a07a32d600/0xedd53ca6b6e472dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136148.920202:0:23375:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.156@tcp lock: ffff94a07a32d600/0xedd53ca6b6e472dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136148.920237:0:23375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4416f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23375:1876044587201536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789136148.920341:0:23375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136148.920402:0:23375:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a050ae79c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789136148.924459:0:23371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587201536 00000100:00100000:2.0:1789136148.924479:0:23371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587201536 00000100:00100000:2.0:1789136148.925845:0:23371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789136148.925865:0:23371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a045424450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+16:23375:x1876044587201536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789136148.925889:0:23371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789136148.925925:0:23371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94a0429a9200/0xedd53ca6b6e472e4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xedd53ca6b6e472dd expref: -99 pid: 23371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136148.925961:0:23371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94a0429a9200/0xedd53ca6b6e472e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedd53ca6b6e472dd expref: 17 pid: 23371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136148.925974:0:23371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94a0429a9200/0xedd53ca6b6e472e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedd53ca6b6e472dd expref: 17 pid: 23371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136148.925984:0:23371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94a0429a9200, rc 0) 00000100:00100000:2.0:1789136148.926088:0:23371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a045424450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+17:23375:x1876044587201536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 230us (5748us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136148.926097:0:23371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789136148.926181:0:23375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4416f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23375:1876044587201536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789136148.926206:0:23375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.156@tcp lock: ffff94a07a32d600/0xedd53ca6b6e472dd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e472e4 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136148.926229:0:23375:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.156@tcp lock: ffff94a07a32d600/0xedd53ca6b6e472dd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xedd53ca6b6e472e4 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136148.928853:0:23375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a06f1a52c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23375:1876044587201664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789136148.928947:0:23375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136148.929009:0:23375:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a052734540 going to sleep for 11 seconds 00000100:00100000:0.0:1789136148.929216:0:23373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587201664 00000100:00100000:0.0:1789136148.929225:0:23373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587201664 00000100:00100000:0.0:1789136148.929289:0:23373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789136148.930226:0:23373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a045425850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3644072c-bb98-4fbe-9eaf-e40d57d161d0+17:23375:x1876044587201664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789136148.930528:0:23373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a045425850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3644072c-bb98-4fbe-9eaf-e40d57d161d0+17:23375:x1876044587201664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1228us (1579us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136148.930539:0:23373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789136148.932000:0:23375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a06f1a52c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23375:1876044587201664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789136148.932077:0:23375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a06f1a52c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23375:1876044587201792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789136148.932160:0:23375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136148.932203:0:23375:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a052734540 going to sleep for 11 seconds 00000100:00100000:2.0:1789136148.932230:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587201792 00000100:00100000:2.0:1789136148.932237:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587201792 00000100:00100000:2.0:1789136148.932288:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789136148.932298:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a045426c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+17:23375:x1876044587201792:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789136148.935311:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a045426c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+17:23375:x1876044587201792:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2994us (3131us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136148.935328:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789136148.937118:0:23375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a06f1a52c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23375:1876044587201792:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789136148.943082:0:24601:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 19 00000020:01000000:0.0:1789136148.945378:0:23375:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 19-18 (rc=0) 10000000:01000000:0.0:1789136148.945430:0:23375:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789136148.945445:0:23375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a07a32d600/0xedd53ca6b6e472dd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e472e4 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136148.945477:0:23375:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.156@tcp lock: ffff94a07a32d600/0xedd53ca6b6e472dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e472e4 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789136148.945491:0:23375:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789136148.945494:0:23375:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff949f449ce800 from 19 10000000:01000000:0.0:1789136148.945497:0:23375:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789136148.945548:0:23375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a0413fce00/0xedd53ca6b6e472eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136148.945556:0:23375:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.156@tcp lock: ffff94a0413fce00/0xedd53ca6b6e472eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136148.945568:0:23375:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.156@tcp lock: ffff94a0413fce00/0xedd53ca6b6e472eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136148.945600:0:23375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07ad98780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23375:1876044587201920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789136148.945755:0:23375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136148.945817:0:23375:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a05075ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789136148.945818:0:23373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587201920 00000100:00100000:3.0:1789136148.945829:0:23373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587201920 00000100:00100000:3.0:1789136148.945897:0:23373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789136148.945909:0:23373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a045424050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3644072c-bb98-4fbe-9eaf-e40d57d161d0+17:23375:x1876044587201920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789136148.945928:0:23373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789136148.945946:0:23373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff949f4483cc00/0xedd53ca6b6e472f2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xedd53ca6b6e472eb expref: -99 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136148.945977:0:23373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff949f4483cc00/0xedd53ca6b6e472f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedd53ca6b6e472eb expref: 18 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136148.946004:0:23373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff949f4483cc00/0xedd53ca6b6e472f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedd53ca6b6e472eb expref: 18 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136148.946015:0:23373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff949f4483cc00, rc 0) 00000100:00100000:3.0:1789136148.946064:0:23373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a045424050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3644072c-bb98-4fbe-9eaf-e40d57d161d0+18:23375:x1876044587201920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136148.946071:0:23373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789136148.947714:0:23375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07ad98780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23375:1876044587201920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789136148.947751:0:23375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.156@tcp lock: ffff94a0413fce00/0xedd53ca6b6e472eb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e472f2 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136148.947764:0:23375:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.156@tcp lock: ffff94a0413fce00/0xedd53ca6b6e472eb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xedd53ca6b6e472f2 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136148.947879:0:23375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07ad98780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23375:1876044587202048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789136148.947944:0:23375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136148.948009:0:23375:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a05075ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789136148.948213:0:23371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587202048 00000100:00100000:3.0:1789136148.948221:0:23371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587202048 00000100:00100000:3.0:1789136148.948286:0:23371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789136148.948297:0:23371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a045427450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+18:23375:x1876044587202048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789136148.948479:0:23371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a045427450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+18:23375:x1876044587202048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 183us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136148.948488:0:23371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789136148.949800:0:23375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07ad98780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23375:1876044587202048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789136148.949863:0:23375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07ad98780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23375:1876044587202176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789136148.949932:0:23375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136148.949977:0:23375:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a05075ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789136148.950080:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587202176 00000100:00100000:3.0:1789136148.950088:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587202176 00000100:00100000:3.0:1789136148.950140:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789136148.950151:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a045427c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+18:23375:x1876044587202176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789136148.950306:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a045427c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+18:23375:x1876044587202176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 156us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136148.950314:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789136148.950515:0:23375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07ad98780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23375:1876044587202176:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789136148.958898:0:24602:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 19 00000020:01000000:2.0:1789136148.959263:0:23375:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 19-18 (rc=0) 10000000:01000000:2.0:1789136148.959306:0:23375:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789136148.959321:0:23375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a0413fce00/0xedd53ca6b6e472eb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e472f2 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136148.959334:0:23375:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.156@tcp lock: ffff94a0413fce00/0xedd53ca6b6e472eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e472f2 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136149.809816:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789136150.512818:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789136140/real 1789136140] req@ffff94a06f1a61c0 x1876044587196288/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789136150 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136150.512845:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff94a06f1a61c0 x1876044587196288/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789136150 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136150.512855:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789136140/real 1789136140] req@ffff94a0556dcf00 x1876044587196160/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789136150 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136150.512868:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff94a0556dcf00 x1876044587196160/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789136150 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789136150.512888:0:3644:0:(import.c:65:import_set_state_nolock()) ffff94a07021d000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789136150.512910:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789136150.512915:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a06f1a61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876044587196288:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1789136150.512920:0:3644:0:(import.c:65:import_set_state_nolock()) ffff949f42648800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789136150.512992:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789136150.512996:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a0556dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876044587196160:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1789136150.515521:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789136150.515527:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789136150.515529:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789136150.515533:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789136150.515577:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789136150.515580:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789136150.515583:0:37:0:(import.c:65:import_set_state_nolock()) ffff949f42648800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789136150.515590:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 678 00000100:00080000:3.0:1789136150.515595:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789136150.515601:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff949f42648800 using connection 192.168.206.156@tcp/0@lo 00000100:00100000:3.0:1789136150.515622:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94a043739a40 x1876044587202816/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789136150.515675:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789136150.515678:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789136150.515680:0:37:0:(import.c:65:import_set_state_nolock()) ffff94a07021d000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789136150.515683:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 678 00000100:00080000:3.0:1789136150.515686:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789136150.515689:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff94a07021d000 using connection 192.168.206.156@tcp/0@lo 00000100:00100000:3.0:1789136150.515701:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94a04373a1c0 x1876044587202944/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789136150.515764:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a043738b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876044587202432:0@lo:400:kworker.0 00000100:00100000:3.0:1789136150.515830:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136150.515906:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a0437383c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876044587203200:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789136150.515985:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136150.516010:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789136150.516016:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a04373bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3644072c-bb98-4fbe-9eaf-e40d57d161d0:3646:1876044587202304:0@lo:400:kworker.0 00000100:00100000:3.0:1789136150.516044:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136150.516067:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a043738780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876044587203072:0@lo:400:kworker.0 00000100:00100000:3.0:1789136150.516115:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136150.516169:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a043739a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876044587202816:0@lo:8:kworker.0 00000400:00000100:0.0:1789136150.516213:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876044587202816 offset 0 length 520: 4 00000100:00100000:0.0:1789136150.516240:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a04373a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876044587202944:0@lo:8:kworker.0 00000400:00000100:0.0:1789136150.516270:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876044587202944 offset 0 length 520: 4 00000100:00100000:3.0:1789136150.516558:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a043738000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876044587202560:0@lo:400:kworker.0 00000100:00100000:3.0:1789136150.516586:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136150.516609:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789136150.516615:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a04373b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876044587202688:0@lo:400:kworker.0 00000100:00100000:0.0:1789136150.516721:0:23384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587202432 00000100:00100000:0.0:1789136150.516733:0:23384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587202432 00000100:00100000:0.0:1789136150.516770:0:23384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587203200 00000100:00100000:0.0:1789136150.516773:0:23384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587203200 00000100:00100000:0.0:1789136150.516788:0:23384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789136150.516796:0:23384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f42b1da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1876044587202432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136150.516847:0:23384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f42b1da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1876044587202432:12345-0@lo:400:kworker.0 Request processed in 51us (1017us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136150.516854:0:23384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789136150.516870:0:23384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789136150.516876:0:23384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f42b1e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876044587203200:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789136150.516899:0:23384:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1789136150.516937:0:23384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f42b1e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876044587203200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 61us (951us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136150.516943:0:23384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789136150.516963:0:23373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587202304 00000100:00100000:0.0:1789136150.516967:0:23373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587202304 00000100:00100000:0.0:1789136150.516991:0:23373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789136150.516996:0:23373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a045424850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3644072c-bb98-4fbe-9eaf-e40d57d161d0+18:3646:x1876044587202304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136150.517023:0:23373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a045424850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3644072c-bb98-4fbe-9eaf-e40d57d161d0+18:3646:x1876044587202304:12345-0@lo:400:kworker.0 Request processed in 27us (978us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136150.517029:0:23373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789136150.517077:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a04373bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3644072c-bb98-4fbe-9eaf-e40d57d161d0:3646:1876044587202304:0@lo:400:kworker.0 00000100:00100000:0.0:1789136150.517094:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a043738b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876044587202432:0@lo:400:kworker.0 00000100:00100000:3.0:1789136150.517711:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136150.517755:0:23380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587203072 00000100:00100000:3.0:1789136150.517759:0:23380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587203072 00000100:00100000:3.0:1789136150.517787:0:23380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587202560 00000100:00100000:3.0:1789136150.517790:0:23380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587202560 00000100:00100000:3.0:1789136150.517801:0:23380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789136150.517807:0:23380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f42b1f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876044587203072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136150.517906:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a0437383c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876044587203200:0@lo:41:osp-pre-0-1.0 00010000:00080000:0.0:1789136150.517939:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94a043738780 x1876044587203072/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136166 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136150.517949:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a043738780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876044587203072:0@lo:400:kworker.0 00000100:00100000:0.0:1789136150.517969:0:23384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587202688 00000100:00100000:0.0:1789136150.517972:0:23384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587202688 00000100:00100000:0.0:1789136150.517994:0:23384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789136150.518001:0:23384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f42b1ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876044587202688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136150.518770:0:23380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f42b1f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876044587203072:12345-0@lo:400:kworker.0 Request processed in 960us (2651us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136150.518779:0:23380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789136150.518800:0:23380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789136150.518808:0:23380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f42b1cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876044587202560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136150.518904:0:23384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f42b1ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876044587202688:12345-0@lo:400:kworker.0 Request processed in 903us (1192us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136150.518911:0:23384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789136150.518957:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a04373b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876044587202688:0@lo:400:kworker.0 00000100:00100000:3.0:1789136150.519358:0:23380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f42b1cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876044587202560:12345-0@lo:400:kworker.0 Request processed in 551us (2769us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136150.519365:0:23380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1789136150.519713:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94a043738000 x1876044587202560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136166 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136150.519725:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a043738000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876044587202560:0@lo:400:kworker.0 00000100:00100000:3.0:1789136150.520446:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789136150.520550:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f42b1e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876044587203328:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789136150.520599:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136150.520670:0:23383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587203328 00000100:00100000:0.0:1789136150.520676:0:23383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587203328 00000100:00100000:0.0:1789136150.520711:0:23383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789136150.520719:0:23383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f42b1e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1876044587203328:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789136150.520747:0:23383:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789136150.522059:0:23383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f42b1e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1876044587203328:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1335us (1453us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136150.522069:0:23383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789136150.522502:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f42b1e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876044587203328:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789136150.833431:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789136151.031327:0:24115:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1789136151.537157:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789136136/real 1789136136] req@ffff949f4416f480 x1876044587194112/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789136151 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136151.537196:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff949f4416f480 x1876044587194112/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789136151 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136151.537206:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789136136/real 1789136136] req@ffff949f4416d2c0 x1876044587194240/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789136151 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136151.537218:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff949f4416d2c0 x1876044587194240/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789136151 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789136151.537236:0:3644:0:(import.c:65:import_set_state_nolock()) ffff949f443e6000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789136151.537260:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789136151.537264:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4416f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876044587194112:0@lo:8:kworker.0 00000100:00080000:3.0:1789136151.537270:0:3644:0:(import.c:65:import_set_state_nolock()) ffff949f443e6800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789136151.537275:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789136151.537278:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4416d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876044587194240:0@lo:8:kworker.0 00000100:00080000:1.0:1789136151.538419:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789136151.538424:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789136151.538427:0:37:0:(import.c:65:import_set_state_nolock()) ffff949f443e6000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789136151.538433:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 674 00000100:00080000:1.0:1789136151.538438:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789136151.538444:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff949f443e6000 using connection 192.168.206.156@tcp/0@lo 00000100:00100000:1.0:1789136151.538464:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff949f4416e1c0 x1876044587203712/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789136151.538477:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789136151.538480:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789136151.538482:0:37:0:(import.c:65:import_set_state_nolock()) ffff949f443e6800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789136151.538485:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 674 00000100:00080000:1.0:1789136151.538487:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789136151.538491:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff949f443e6800 using connection 192.168.206.156@tcp/0@lo 00000100:00100000:1.0:1789136151.538501:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff949f4416e940 x1876044587203840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789136151.538534:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789136151.538537:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789136151.538540:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789136151.538542:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789136151.538570:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4416c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876044587204096:0@lo:400:kworker.0 00000100:00100000:1.0:1789136151.538647:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136151.538683:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789136151.538689:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4416c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3644072c-bb98-4fbe-9eaf-e40d57d161d0:3647:1876044587203456:0@lo:400:kworker.0 00000100:00100000:1.0:1789136151.538718:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136151.538749:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4416cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876044587204224:0@lo:400:kworker.0 00000100:00100000:1.0:1789136151.538779:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136151.538807:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4416cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876044587203584:0@lo:400:kworker.0 00000100:00100000:2.0:1789136151.538832:0:23371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587203456 00000100:00100000:1.0:1789136151.538834:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136151.538841:0:23371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587203456 00000100:00100000:1.0:1789136151.538857:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789136151.538864:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4416d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876044587203968:0@lo:400:kworker.0 00000100:00100000:2.0:1789136151.538984:0:23371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789136151.538995:0:23371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a045426450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+18:3647:x1876044587203456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136151.539025:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136151.539058:0:23371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a045426450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+18:3647:x1876044587203456:12345-0@lo:400:kworker.0 Request processed in 65us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136151.539065:0:23383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587204096 00000100:00100000:2.0:1789136151.539069:0:23371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789136151.539071:0:23383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587204096 00000100:00100000:1.0:1789136151.539108:0:23383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587203584 00000100:00100000:1.0:1789136151.539112:0:23383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587203584 00000100:00100000:1.0:1789136151.539131:0:23383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789136151.539140:0:23383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f4416d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876044587204096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136151.539176:0:23383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f4416d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876044587204096:12345-0@lo:400:kworker.0 Request processed in 39us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136151.539193:0:23383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789136151.539208:0:23383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789136151.539215:0:23383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f4416ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876044587203584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136151.539250:0:23383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f4416ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876044587203584:12345-0@lo:400:kworker.0 Request processed in 36us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136151.539257:0:23383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789136151.539292:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4416cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876044587203584:0@lo:400:kworker.0 00000100:00100000:1.0:1789136151.539319:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4416c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3644072c-bb98-4fbe-9eaf-e40d57d161d0:3647:1876044587203456:0@lo:400:kworker.0 00000100:00100000:3.0:1789136151.539450:0:23380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587204224 00000100:00100000:3.0:1789136151.539455:0:23380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587204224 00000100:00100000:3.0:1789136151.539479:0:23380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587203968 00000100:00100000:3.0:1789136151.539481:0:23380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587203968 00000100:00100000:3.0:1789136151.539493:0:23380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789136151.539498:0:23380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f4416f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876044587204224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136151.539540:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4416c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876044587204096:0@lo:400:kworker.0 00000100:00100000:2.0:1789136151.541421:0:23378:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1789136151.541802:0:23378:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1789136151.541830:0:23380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f4416f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876044587204224:12345-0@lo:400:kworker.0 Request processed in 2327us (3047us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136151.541843:0:23380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789136151.541879:0:23380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789136151.541890:0:23380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f4416e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876044587203968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136151.541955:0:23380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f4416e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876044587203968:12345-0@lo:400:kworker.0 Request processed in 69us (2932us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136151.541961:0:23380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789136151.542048:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4416e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876044587203712:0@lo:8:kworker.0 00000400:00000100:2.0:1789136151.542226:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876044587203712 offset 0 length 520: 4 00000100:00100000:2.0:1789136151.542259:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4416e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876044587203840:0@lo:8:kworker.0 00000400:00000100:2.0:1789136151.542292:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876044587203840 offset 0 length 520: 4 00010000:00080000:1.0:1789136151.545870:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff949f4416cf00 x1876044587204224/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136151.545889:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4416cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876044587204224:0@lo:400:kworker.0 00010000:00080000:1.0:1789136151.545941:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff949f4416d680 x1876044587203968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136151.545951:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4416d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876044587203968:0@lo:400:kworker.0 00010000:00010000:0.0:1789136151.861900:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789136152.433574:0:24136:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789136152.880821:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136153.905384:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789136153.989408:0:24888:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789136153.989412:0:24888:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1789136153.989413:0:24888:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1789136153.989523:0:24888:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff94a0660f3000 00000020:01000004:3.0:1789136153.989539:0:24888:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1789136153.989552:0:24888:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789136153.989566:0:24888:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff94a060011a48) 00000020:00000080:3.0:1789136153.989584:0:24888:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789136154.050567:0:24888:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1789136154.052276:0:24888:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1789136154.052670:0:24888:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1789136154.053259:0:24888:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1789136154.053656:0:24888:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1789136154.053908:0:24888:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1789136154.054229:0:24888:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:01000000:3.0:1789136154.057032:0:24888:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789136154.057305:0:24888:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1789136154.057334:0:24888:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789136154.057345:0:24888:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xedd53ca6b6e47300 00000020:01000004:3.0:1789136154.057352:0:24888:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1789136154.057374:0:24888:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.156@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789136154.057377:0:24888:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.156@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789136154.057383:0:24888:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1789136154.057388:0:24888:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1789136154.057399:0:24888:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff94a060010000) 00000020:00000080:3.0:1789136154.057413:0:24888:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:3.0:1789136154.059056:0:24888:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789136154.059402:0:24888:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1789136154.059408:0:24888:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1789136154.062987:0:24888:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1789136154.062998:0:24888:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1789136154.065710:0:24888:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1789136154.065724:0:24888:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1789136154.067467:0:24888:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789136154.068085:0:24888:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1789136154.068092:0:24888:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1789136154.072691:0:24888:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1789136154.072706:0:24888:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1789136154.094196:0:24888:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789136154.094933:0:24888:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789136154.094940:0:24888:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1789136154.098110:0:24888:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789136154.098125:0:24888:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1789136154.100323:0:24888:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789136154.100348:0:24888:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1789136154.104267:0:24888:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789136154.104975:0:24888:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1789136154.104983:0:24888:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1789136154.108042:0:24888:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1789136154.108055:0:24888:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1789136154.151049:0:24888:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789136154.151295:0:24888:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1789136154.151301:0:24888:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1789136154.153918:0:24888:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1789136154.153932:0:24888:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1789136154.154832:0:24888:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1789136154.154863:0:24888:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1789136154.154869:0:24888:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.156@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1789136154.166553:0:24888:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.156@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789136154.166591:0:24888:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.156@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1789136154.166595:0:24888:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789136154.166597:0:24888:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789136154.166599:0:24888:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789136154.166600:0:24888:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789136154.166601:0:24888:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789136154.166602:0:24888:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789136154.166603:0:24888:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789136154.166605:0:24888:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789136154.166607:0:24888:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789136154.166611:0:24888:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1789136154.166613:0:24888:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789136154.166614:0:24888:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789136154.166615:0:24888:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789136154.166616:0:24888:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789136154.166617:0:24888:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789136154.166618:0:24888:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789136154.166619:0:24888:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789136154.166620:0:24888:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789136154.166621:0:24888:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789136154.166948:0:24888:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789136154.166968:0:24888:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07ad992c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24888:1876044587204352:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789136154.167036:0:24888:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136154.167148:0:24888:0:(client.c:2715:ptlrpc_set_wait()) set ffff949f428169c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789136154.167261:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587204352 00000100:00100000:3.0:1789136154.167268:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587204352 00000100:00100000:3.0:1789136154.167367:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789136154.167377:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a08199a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+18:24888:x1876044587204352:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789136154.167405:0:23372:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1789136154.167409:0:23372:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1789136154.167425:0:23372:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1789136154.167932:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a08199a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+18:24888:x1876044587204352:12345-0@lo:253:mount.lustre.0 Request processed in 554us (892us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136154.167942:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789136154.168010:0:24888:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07ad992c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24888:1876044587204352:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789136154.168021:0:24888:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789136154.168024:0:24888:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789136154.168026:0:24888:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789136154.168027:0:24888:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789136154.168028:0:24888:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789136154.168029:0:24888:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789136154.168030:0:24888:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789136154.168032:0:24888:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789136154.168033:0:24888:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789136154.168034:0:24888:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789136154.168050:0:24888:0:(tgt_mount.c:101:server_register_mount()) register mount ffff94a0660f3000 from lustre-OST0000 10000000:01000000:0.0:1789136154.168075:0:24888:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1789136154.168078:0:24888:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789136154.168086:0:24888:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff949f44320000 local copy 00010000:00010000:0.0:1789136154.168096:0:24888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a0429a9600/0xedd53ca6b6e470bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e470c2 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136154.168188:0:24888:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07ad992c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24888:1876044587204480:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789136154.168216:0:24888:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136154.168684:0:24888:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a076aea6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789136154.168875:0:23371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587204480 00000100:00100000:2.0:1789136154.168882:0:23371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587204480 00000100:00100000:2.0:1789136154.168915:0:23371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789136154.168923:0:23371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a081999850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+18:24888:x1876044587204480:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789136154.169007:0:23371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a081999850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+18:24888:x1876044587204480:12345-0@lo:501:mount.lustre.0 Request processed in 84us (789us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789136154.169015:0:23371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789136154.169095:0:24888:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07ad992c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24888:1876044587204480:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789136154.169109:0:24888:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.156@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789136154.169140:0:24888:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.156@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789136154.169146:0:24888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a0429a9600/0xedd53ca6b6e470bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e470c2 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136154.169155:0:24888:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.156@tcp lock: ffff94a0429a9600/0xedd53ca6b6e470bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e470c2 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789136154.169177:0:24888:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff94a0660f3000 10000000:01000000:0.0:1789136154.169191:0:24888:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789136154.169196:0:24888:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789136154.169198:0:24888:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789136154.169202:0:24888:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1789136154.169205:0:24888:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789136154.169226:0:24888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a0413fcc00/0xedd53ca6b6e4730e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136154.169235:0:24888:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.156@tcp lock: ffff94a0413fcc00/0xedd53ca6b6e4730e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136154.169244:0:24888:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.156@tcp lock: ffff94a0413fcc00/0xedd53ca6b6e4730e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136154.169257:0:24888:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07ad992c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24888:1876044587204608:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789136154.169284:0:24888:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136154.169311:0:24888:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a076aea6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789136154.169577:0:23371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587204608 00000100:00100000:2.0:1789136154.169582:0:23371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587204608 00000100:00100000:2.0:1789136154.169602:0:23371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789136154.169609:0:23371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a08199bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+18:24888:x1876044587204608:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789136154.169617:0:23371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789136154.169657:0:23371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94a0429a8400/0xedd53ca6b6e47315 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xedd53ca6b6e4730e expref: -99 pid: 23371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136154.169677:0:23371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94a0429a8400/0xedd53ca6b6e47315 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedd53ca6b6e4730e expref: 19 pid: 23371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136154.169687:0:23371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94a0429a8400/0xedd53ca6b6e47315 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedd53ca6b6e4730e expref: 19 pid: 23371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136154.169696:0:23371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94a0429a8400, rc 0) 00000100:00100000:2.0:1789136154.169743:0:23371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a08199bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+19:24888:x1876044587204608:12345-0@lo:101:mount.lustre.0 Request processed in 123us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136154.169749:0:23371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789136154.169936:0:24888:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07ad992c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24888:1876044587204608:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789136154.169948:0:24888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.156@tcp lock: ffff94a0413fcc00/0xedd53ca6b6e4730e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e47315 expref: -99 pid: 24888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136154.169957:0:24888:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.156@tcp lock: ffff94a0413fcc00/0xedd53ca6b6e4730e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xedd53ca6b6e47315 expref: -99 pid: 24888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789136154.171080:0:24888:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:0.0:1789136154.171973:0:24888:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789136154.175207:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1789136154.175257:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:0.0:1789136154.175275:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:0.0:1789136154.175290:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:0.0:1789136154.175337:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:0.0:1789136154.175356:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:0.0:1789136154.175372:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:0.0:1789136154.175384:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:0.0:1789136154.175396:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:0.0:1789136154.175407:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:0.0:1789136154.175793:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:0.0:1789136154.175814:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:0.0:1789136154.175841:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:0.0:1789136154.175847:0:24888:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:0.0:1789136154.175942:0:24888:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07ad992c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24888:1876044587204736:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789136154.176000:0:24888:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136154.176164:0:23373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587204736 00000100:00100000:1.0:1789136154.176172:0:23373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587204736 00000100:00100000:0.0:1789136154.176343:0:24888:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a076aea0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789136154.176484:0:23371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789136154.176496:0:23371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a081999450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+19:24888:x1876044587204736:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789136154.176717:0:23371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a081999450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+19:24888:x1876044587204736:12345-0@lo:501:mount.lustre.0 Request processed in 222us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136154.176726:0:23371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789136154.176835:0:24888:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07ad992c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24888:1876044587204736:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789136154.176868:0:24888:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07ad992c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24888:1876044587204864:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789136154.176914:0:24888:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136154.176935:0:24888:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a076aea0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789136154.176986:0:23371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587204864 00000100:00100000:3.0:1789136154.176994:0:23371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587204864 00000100:00100000:3.0:1789136154.177011:0:23371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789136154.177016:0:23371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a08199a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+19:24888:x1876044587204864:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789136154.177994:0:23371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a08199a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+19:24888:x1876044587204864:12345-0@lo:503:mount.lustre.0 Request processed in 973us (1075us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136154.178003:0:23371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789136154.178201:0:24888:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07ad992c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24888:1876044587204864:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789136154.178883:0:24888:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789136154.178954:0:24888:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07ad992c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24888:1876044587204992:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789136154.179005:0:24888:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136154.179084:0:24888:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a076aea6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789136154.179191:0:23373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587204992 00000100:00100000:1.0:1789136154.179198:0:23373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587204992 00000100:00100000:1.0:1789136154.179282:0:23373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789136154.179299:0:23373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a08199b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3644072c-bb98-4fbe-9eaf-e40d57d161d0+19:24888:x1876044587204992:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789136154.179920:0:23373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a08199b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3644072c-bb98-4fbe-9eaf-e40d57d161d0+19:24888:x1876044587204992:12345-0@lo:502:mount.lustre.0 Request processed in 621us (912us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136154.179928:0:23373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789136154.180011:0:24888:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07ad992c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24888:1876044587204992:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789136154.180250:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1789136154.180277:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:2.0:1789136154.180294:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:2.0:1789136154.180341:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:2.0:1789136154.180359:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:2.0:1789136154.180371:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:2.0:1789136154.180386:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:2.0:1789136154.180399:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:2.0:1789136154.180428:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:2.0:1789136154.180445:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:2.0:1789136154.180461:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:2.0:1789136154.180476:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:2.0:1789136154.180504:0:24888:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a06f1a43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24888:1876044587205120:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789136154.180546:0:24888:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136154.181007:0:24888:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a070130840 going to sleep for 11 seconds 00000100:00100000:3.0:1789136154.181071:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587205120 00000100:00100000:3.0:1789136154.181077:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587205120 00000100:00100000:3.0:1789136154.181110:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789136154.181188:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a08199b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+19:24888:x1876044587205120:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789136154.181301:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a08199b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+19:24888:x1876044587205120:12345-0@lo:502:mount.lustre.0 Request processed in 117us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136154.181309:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789136154.181420:0:24888:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a06f1a43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24888:1876044587205120:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789136154.181475:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:2.0:1789136154.181485:0:24888:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:2.0:1789136154.182661:0:24905:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789136154.182672:0:24905:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1789136154.182678:0:24905:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789136154.182680:0:24905:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1789136154.182685:0:24905:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789136154.182699:0:24905:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff949f42671a48) 00000020:00000080:2.0:1789136154.182721:0:24905:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789136154.182744:0:24905:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789136154.182823:0:24905:0:(tgt_mount.c:153:server_get_mount()) get mount ffff94a0660f3000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1789136154.182832:0:24905:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789136154.182838:0:24905:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xedd53ca6b6e47323 00010000:00010000:2.0:1789136154.187574:0:24905:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:2.0:1789136154.188164:0:24905:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934600 00080000:10000000:1.0:1789136154.189976:0:24905:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000003:0xc:0x0] (8/32) registered 00000020:00000080:2.0:1789136154.194596:0:24905:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1789136154.194609:0:24905:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789136154.194617:0:24905:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789136154.194619:0:24905:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1789136154.194623:0:24905:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789136154.194654:0:24905:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:2.0:1789136154.194656:0:24905:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789136154.194658:0:24905:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789136154.194660:0:24905:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789136154.194664:0:24905:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789136154.194665:0:24905:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789136154.194668:0:24905:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789136154.194672:0:24905:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789136154.194673:0:24905:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789136154.194676:0:24905:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789136154.194678:0:24905:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789136154.194680:0:24905:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789136154.194682:0:24905:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789136154.194683:0:24905:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789136154.194685:0:24905:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789136154.194687:0:24905:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789136154.194689:0:24905:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789136154.194692:0:24905:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1789136154.194713:0:24905:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789136154.194716:0:24905:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789136154.194718:0:24905:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789136154.194721:0:24905:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:1.0:1789136154.194925:0:24888:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1789136154.194953:0:24888:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.156@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789136154.194970:0:24888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a0413fcc00/0xedd53ca6b6e4730e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e47315 expref: -99 pid: 24888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136154.194982:0:24888:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.156@tcp lock: ffff94a0413fcc00/0xedd53ca6b6e4730e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e47315 expref: -99 pid: 24888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789136154.194990:0:24888:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94a0660f3000 from 1 10000000:01000000:1.0:1789136154.194992:0:24888:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789136154.195024:0:24888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a07a32d200/0xedd53ca6b6e4732a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136154.195031:0:24888:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.156@tcp lock: ffff94a07a32d200/0xedd53ca6b6e4732a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136154.195041:0:24888:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.156@tcp lock: ffff94a07a32d200/0xedd53ca6b6e4732a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136154.195062:0:24888:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4416d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24888:1876044587205248:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789136154.195212:0:24888:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136154.195534:0:24888:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a051609000 going to sleep for 11 seconds 00000100:00100000:2.0:1789136154.198539:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587205248 00000100:00100000:2.0:1789136154.198556:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587205248 00000100:00100000:2.0:1789136154.198603:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789136154.198612:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a081998050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+19:24888:x1876044587205248:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789136154.198645:0:23372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789136154.198660:0:23372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94a0429a9800/0xedd53ca6b6e47331 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xedd53ca6b6e4732a expref: -99 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136154.198685:0:23372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94a0429a9800/0xedd53ca6b6e47331 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedd53ca6b6e4732a expref: 20 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136154.198696:0:23372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94a0429a9800/0xedd53ca6b6e47331 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedd53ca6b6e4732a expref: 20 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136154.198704:0:23372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94a0429a9800, rc 0) 00000100:00100000:2.0:1789136154.198911:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a081998050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+20:24888:x1876044587205248:12345-0@lo:101:mount.lustre.0 Request processed in 299us (3698us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136154.198919:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789136154.198998:0:24888:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4416d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24888:1876044587205248:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789136154.199017:0:24888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.156@tcp lock: ffff94a07a32d200/0xedd53ca6b6e4732a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e47331 expref: -99 pid: 24888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136154.199039:0:24888:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.156@tcp lock: ffff94a07a32d200/0xedd53ca6b6e4732a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xedd53ca6b6e47331 expref: -99 pid: 24888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789136154.200502:0:24888:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 19 count 19 00000040:00080000:2.0:1789136154.200787:0:24888:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789136154.200951:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1789136154.200978:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:2.0:1789136154.200994:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:2.0:1789136154.201010:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:2.0:1789136154.201023:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:2.0:1789136154.201037:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:2.0:1789136154.201050:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:2.0:1789136154.201064:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 144 off9680 00000040:00080000:2.0:1789136154.201076:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9904 00000040:00080000:2.0:1789136154.201088:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10128 00000040:00080000:2.0:1789136154.201100:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 144 off10272 00000040:00080000:2.0:1789136154.201112:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10496 00000040:00080000:2.0:1789136154.201394:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 224 off10720 00000040:00080000:2.0:1789136154.201489:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 128 off10848 00000040:00080000:2.0:1789136154.201508:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off11072 00000040:00080000:2.0:1789136154.201522:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11296 00000040:00080000:2.0:1789136154.201536:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 128 off11424 00000040:00080000:2.0:1789136154.201571:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11648 00000040:00080000:2.0:1789136154.201578:0:24888:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 18 count 19 00000100:00100000:2.0:1789136154.201914:0:24888:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a06f1a43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24888:1876044587205376:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789136154.201976:0:24888:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136154.202059:0:24888:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a0701303c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789136154.202992:0:23371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587205376 00000100:00100000:3.0:1789136154.203000:0:23371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587205376 00000100:00100000:3.0:1789136154.203048:0:23371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789136154.203057:0:23371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a076bd1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+20:24888:x1876044587205376:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789136154.203410:0:23371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a076bd1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+20:24888:x1876044587205376:12345-0@lo:501:mount.lustre.0 Request processed in 354us (1432us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136154.203546:0:23371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789136154.205521:0:24888:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a06f1a43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24888:1876044587205376:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789136154.205578:0:24888:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a06f1a43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24888:1876044587205504:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789136154.206399:0:24888:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136154.206717:0:24888:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a0701303c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789136154.209294:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587205504 00000100:00100000:3.0:1789136154.209306:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587205504 00000100:00100000:3.0:1789136154.209577:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789136154.209588:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a076bd3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+20:24888:x1876044587205504:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789136154.209791:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a076bd3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+20:24888:x1876044587205504:12345-0@lo:503:mount.lustre.0 Request processed in 203us (3392us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136154.209809:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789136154.209913:0:24888:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a06f1a43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24888:1876044587205504:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789136154.210701:0:24888:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789136154.210793:0:24888:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a06f1a43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24888:1876044587205632:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789136154.210852:0:24888:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136154.211135:0:24888:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a0701303c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789136154.211303:0:23373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587205632 00000100:00100000:1.0:1789136154.211310:0:23373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587205632 00000100:00100000:1.0:1789136154.211357:0:23373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789136154.211371:0:23373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a076bd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3644072c-bb98-4fbe-9eaf-e40d57d161d0+20:24888:x1876044587205632:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789136154.211591:0:23373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a076bd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3644072c-bb98-4fbe-9eaf-e40d57d161d0+20:24888:x1876044587205632:12345-0@lo:502:mount.lustre.0 Request processed in 220us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136154.211598:0:23373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789136154.211719:0:24888:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a06f1a43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24888:1876044587205632:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789136154.211921:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1789136154.211950:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1789136154.211963:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1789136154.211976:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1789136154.211988:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1789136154.211999:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1789136154.212009:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:2.0:1789136154.212030:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 144 off9680 00000040:00080000:2.0:1789136154.212042:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9904 00000040:00080000:2.0:1789136154.212055:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10128 00000040:00080000:2.0:1789136154.212069:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 144 off10272 00000040:00080000:2.0:1789136154.212083:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10496 00000040:00080000:2.0:1789136154.212113:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 224 off10720 00000040:00080000:2.0:1789136154.212312:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 128 off10848 00000040:00080000:2.0:1789136154.212351:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off11072 00000040:00080000:2.0:1789136154.212368:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11296 00000040:00080000:2.0:1789136154.212381:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 128 off11424 00000100:00100000:2.0:1789136154.212536:0:24888:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a06f1a43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24888:1876044587205760:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789136154.212589:0:24888:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136154.212664:0:24888:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a0701303c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789136154.212815:0:23373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587205760 00000100:00100000:1.0:1789136154.212821:0:23373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587205760 00000100:00100000:1.0:1789136154.212849:0:23373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789136154.212856:0:23373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a076bd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3644072c-bb98-4fbe-9eaf-e40d57d161d0+20:24888:x1876044587205760:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789136154.212985:0:23373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a076bd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3644072c-bb98-4fbe-9eaf-e40d57d161d0+20:24888:x1876044587205760:12345-0@lo:502:mount.lustre.0 Request processed in 130us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136154.212994:0:23373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789136154.213404:0:24888:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a06f1a43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24888:1876044587205760:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789136154.213536:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11648 00000040:00080000:2.0:1789136154.213547:0:24888:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 18 count 19 00000020:01000000:1.0:1789136154.214536:0:24909:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789136154.214551:0:24909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136154.214553:0:24909:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789136154.214560:0:24909:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff94a0660f3000 00000020:00000080:1.0:1789136154.214562:0:24909:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789136154.214569:0:24909:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789136154.214571:0:24909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136154.214572:0:24909:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789136154.214574:0:24909:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789136154.214576:0:24909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136154.214577:0:24909:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789136154.214579:0:24909:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff94a0660f3000 00000020:00000080:1.0:1789136154.214581:0:24909:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789136154.214847:0:24909:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789136154.214898:0:24909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789136154.214901:0:24909:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1789136154.214905:0:24909:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789136154.214908:0:24909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789136154.214910:0:24909:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789136154.214913:0:24909:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff94a0660f3000 00000020:00000080:2.0:1789136154.214916:0:24909:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789136154.221660:0:24909:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789136154.221681:0:24909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789136154.221684:0:24909:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789136154.221689:0:24909:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789136154.221693:0:24909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789136154.221694:0:24909:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789136154.221699:0:24909:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff94a0660f3000 00000020:00000080:2.0:1789136154.221702:0:24909:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789136154.221776:0:24909:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789136154.221779:0:24909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789136154.221781:0:24909:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789136154.221783:0:24909:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789136154.221786:0:24909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789136154.221787:0:24909:0:(obd_config.c:1563:class_process_config()) marker 6 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789136154.221790:0:24909:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff94a0660f3000 00000020:00000080:2.0:1789136154.221792:0:24909:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789136154.221809:0:24909:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789136154.221812:0:24909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789136154.221813:0:24909:0:(obd_config.c:1563:class_process_config()) marker 6 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789136154.221816:0:24909:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789136154.221818:0:24909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789136154.221819:0:24909:0:(obd_config.c:1563:class_process_config()) marker 7 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1789136154.221822:0:24909:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff94a0660f3000 00000020:00000080:2.0:1789136154.221824:0:24909:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789136154.221859:0:24909:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789136154.221863:0:24909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789136154.221865:0:24909:0:(obd_config.c:1563:class_process_config()) marker 7 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1789136154.221868:0:24909:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 19 count 19 00000020:01000000:0.0:1789136154.224455:0:24888:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-18 (rc=0) 10000000:01000000:0.0:1789136154.224501:0:24888:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789136154.224525:0:24888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a07a32d200/0xedd53ca6b6e4732a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e47331 expref: -99 pid: 24888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136154.224538:0:24888:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.156@tcp lock: ffff94a07a32d200/0xedd53ca6b6e4732a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e47331 expref: -99 pid: 24888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789136154.224599:0:24888:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789136154.224602:0:24888:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff94a0660f3000 10000000:01000000:0.0:1789136154.224605:0:24888:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff94a0660f3000 10000000:01000000:0.0:1789136154.224609:0:24888:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789136154.224614:0:24888:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff94a0660f3000 from 1 10000000:01000000:0.0:1789136154.224617:0:24888:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789136154.224667:0:24888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a0413fc800/0xedd53ca6b6e47338 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136154.224676:0:24888:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.156@tcp lock: ffff94a0413fc800/0xedd53ca6b6e47338 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136154.224686:0:24888:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.156@tcp lock: ffff94a0413fc800/0xedd53ca6b6e47338 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136154.224709:0:24888:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07ad98000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24888:1876044587205888:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789136154.224787:0:24888:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136154.224838:0:24888:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a076aea0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789136154.225039:0:23373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587205888 00000100:00100000:1.0:1789136154.225046:0:23373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587205888 00000100:00100000:1.0:1789136154.225099:0:23373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789136154.225109:0:23373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a076bd1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3644072c-bb98-4fbe-9eaf-e40d57d161d0+20:24888:x1876044587205888:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789136154.225131:0:23373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789136154.225143:0:23373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94a07a32da00/0xedd53ca6b6e4733f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xedd53ca6b6e47338 expref: -99 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136154.225166:0:23373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94a07a32da00/0xedd53ca6b6e4733f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedd53ca6b6e47338 expref: 21 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136154.225178:0:23373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94a07a32da00/0xedd53ca6b6e4733f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedd53ca6b6e47338 expref: 21 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136154.225187:0:23373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94a07a32da00, rc 0) 00000100:00100000:1.0:1789136154.225229:0:23373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a076bd1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3644072c-bb98-4fbe-9eaf-e40d57d161d0+21:24888:x1876044587205888:12345-0@lo:101:mount.lustre.0 Request processed in 121us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136154.225236:0:23373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789136154.226905:0:24888:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07ad98000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24888:1876044587205888:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789136154.226929:0:24888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.156@tcp lock: ffff94a0413fc800/0xedd53ca6b6e47338 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e4733f expref: -99 pid: 24888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136154.226939:0:24888:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.156@tcp lock: ffff94a0413fc800/0xedd53ca6b6e47338 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xedd53ca6b6e4733f expref: -99 pid: 24888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789136154.232394:0:24888:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:1.0:1789136154.233925:0:24888:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789136154.234122:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1789136154.234149:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:1.0:1789136154.234165:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:1.0:1789136154.234177:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:1.0:1789136154.234189:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:1.0:1789136154.234201:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:1.0:1789136154.234213:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:1.0:1789136154.234226:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:1.0:1789136154.234256:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:1.0:1789136154.234273:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:1.0:1789136154.234287:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:1.0:1789136154.234300:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:1.0:1789136154.235509:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:1.0:1789136154.235566:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:1.0:1789136154.235594:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:1.0:1789136154.235608:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:1.0:1789136154.235619:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:1.0:1789136154.235644:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:1.0:1789136154.235656:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:1.0:1789136154.235666:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:1.0:1789136154.235676:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:1.0:1789136154.235686:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:1.0:1789136154.235696:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:1.0:1789136154.235707:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:1.0:1789136154.236686:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:1.0:1789136154.236720:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:1.0:1789136154.236804:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:1.0:1789136154.236822:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:1.0:1789136154.236838:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:1.0:1789136154.236852:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:1.0:1789136154.236866:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:1.0:1789136154.236879:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:1.0:1789136154.236893:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:1.0:1789136154.236905:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:1.0:1789136154.236918:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:1.0:1789136154.236931:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:1.0:1789136154.236941:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:1.0:1789136154.236951:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:1.0:1789136154.236962:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:1.0:1789136154.236973:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:1.0:1789136154.237000:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:1.0:1789136154.237014:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:1.0:1789136154.237025:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:1.0:1789136154.237038:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:1.0:1789136154.237050:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:1.0:1789136154.237061:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:1.0:1789136154.237075:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:1.0:1789136154.237103:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:1.0:1789136154.237249:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:1.0:1789136154.237272:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:1.0:1789136154.237292:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:1.0:1789136154.237297:0:24888:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:1.0:1789136154.238647:0:24888:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4416cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24888:1876044587206016:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789136154.238722:0:24888:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136154.238931:0:24888:0:(client.c:2715:ptlrpc_set_wait()) set ffff949f429ddf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789136154.239448:0:23371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587206016 00000100:00100000:0.0:1789136154.239455:0:23371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587206016 00000100:00100000:0.0:1789136154.239506:0:23371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789136154.239516:0:23371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a076bd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+21:24888:x1876044587206016:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789136154.239665:0:23371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a076bd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+21:24888:x1876044587206016:12345-0@lo:501:mount.lustre.0 Request processed in 151us (943us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136154.239673:0:23371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789136154.240884:0:24888:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4416cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24888:1876044587206016:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789136154.240935:0:24888:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4416cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24888:1876044587206144:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789136154.240994:0:24888:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136154.241031:0:24888:0:(client.c:2715:ptlrpc_set_wait()) set ffff949f429ddf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789136154.241619:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587206144 00000100:00100000:0.0:1789136154.241651:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587206144 00000100:00100000:0.0:1789136154.241700:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789136154.241708:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a076bd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+21:24888:x1876044587206144:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789136154.242653:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a076bd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+21:24888:x1876044587206144:12345-0@lo:503:mount.lustre.0 Request processed in 942us (1656us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136154.242663:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789136154.248996:0:24888:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4416cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24888:1876044587206144:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789136154.251657:0:24888:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789136154.251968:0:24888:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4416cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24888:1876044587206272:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789136154.252044:0:24888:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136154.252089:0:24888:0:(client.c:2715:ptlrpc_set_wait()) set ffff949f429ddf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789136154.252181:0:23373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587206272 00000100:00100000:0.0:1789136154.252188:0:23373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587206272 00000100:00100000:0.0:1789136154.252228:0:23373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789136154.252238:0:23373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a076bd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3644072c-bb98-4fbe-9eaf-e40d57d161d0+21:24888:x1876044587206272:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789136154.252498:0:23373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a076bd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3644072c-bb98-4fbe-9eaf-e40d57d161d0+21:24888:x1876044587206272:12345-0@lo:502:mount.lustre.0 Request processed in 261us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136154.252512:0:23373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789136154.252690:0:24888:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4416cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24888:1876044587206272:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789136154.252939:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1789136154.252964:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:0.0:1789136154.252975:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:0.0:1789136154.252986:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:0.0:1789136154.252998:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:0.0:1789136154.253009:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:0.0:1789136154.253020:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:0.0:1789136154.253031:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:0.0:1789136154.253042:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1789136154.253053:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:0.0:1789136154.253065:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:0.0:1789136154.253077:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:0.0:1789136154.253091:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:0.0:1789136154.253119:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:0.0:1789136154.253134:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:0.0:1789136154.253146:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:0.0:1789136154.253158:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:0.0:1789136154.253169:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:0.0:1789136154.253180:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:0.0:1789136154.253192:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:0.0:1789136154.253204:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:0.0:1789136154.253214:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:0.0:1789136154.253225:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:0.0:1789136154.253238:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:0.0:1789136154.253251:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:0.0:1789136154.253264:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:0.0:1789136154.253276:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:0.0:1789136154.253287:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:0.0:1789136154.253310:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:0.0:1789136154.255606:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:0.0:1789136154.255656:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:0.0:1789136154.255671:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:0.0:1789136154.255685:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:0.0:1789136154.255698:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:0.0:1789136154.255711:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:0.0:1789136154.255724:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:1.0:1789136154.256596:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:1.0:1789136154.256622:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:1.0:1789136154.256665:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:1.0:1789136154.256680:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:1.0:1789136154.256708:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:1.0:1789136154.256726:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:1.0:1789136154.257895:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:1.0:1789136154.257916:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:1.0:1789136154.257931:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:1.0:1789136154.257943:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:1.0:1789136154.257956:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:1.0:1789136154.257983:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:1.0:1789136154.258037:0:24888:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4416c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24888:1876044587206400:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789136154.258114:0:24888:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136154.258146:0:24888:0:(client.c:2715:ptlrpc_set_wait()) set ffff949f429dd9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789136154.258828:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587206400 00000100:00100000:0.0:1789136154.258835:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587206400 00000100:00100000:0.0:1789136154.258880:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789136154.258889:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a076bd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+21:24888:x1876044587206400:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789136154.259016:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a076bd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+21:24888:x1876044587206400:12345-0@lo:502:mount.lustre.0 Request processed in 128us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136154.259024:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789136154.259586:0:24888:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4416c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24888:1876044587206400:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789136154.260561:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:1.0:1789136154.260598:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:1.0:1789136154.260656:0:24888:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4416c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24888:1876044587206528:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789136154.260715:0:24888:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136154.260980:0:24888:0:(client.c:2715:ptlrpc_set_wait()) set ffff949f429dd9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789136154.272456:0:23371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587206528 00000100:00100000:0.0:1789136154.272470:0:23371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587206528 00000100:00100000:0.0:1789136154.272518:0:23371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789136154.272527:0:23371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a076bd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+21:24888:x1876044587206528:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789136154.272699:0:23371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a076bd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+21:24888:x1876044587206528:12345-0@lo:502:mount.lustre.0 Request processed in 173us (11983us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136154.272707:0:23371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789136154.273034:0:24888:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4416c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24888:1876044587206528:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789136154.273111:0:24888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:0.0:1789136154.273124:0:24888:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1789136154.275034:0:24916:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1789136154.275051:0:24916:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff949f42673490) 00000020:00000080:2.0:1789136154.275075:0:24916:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:2.0:1789136154.275163:0:24916:0:(tgt_mount.c:153:server_get_mount()) get mount ffff94a0660f3000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789136154.275168:0:24916:0:(tgt_mount.c:187:server_put_mount()) put mount ffff94a0660f3000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789136154.275170:0:24916:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94a0660f3000 3 00010000:00080000:2.0:1789136154.275208:0:24916:0:(ldlm_lib.c:102:import_set_conn()) imp ffff949f42bab000@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.156@tcp at head 00010000:00010000:2.0:1789136154.283902:0:24916:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:2.0:1789136154.286176:0:24916:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1789136154.286223:0:24916:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789136154.286235:0:24916:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xedd53ca6b6e4734d 00000100:00080000:2.0:1789136154.286245:0:24916:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789136154.286258:0:24916:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff949f42bab000 using connection 192.168.206.156@tcp/0@lo 00000100:00100000:2.0:1789136154.286293:0:24916:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94a06f1a43c0 x1876044587206656/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789136154.286356:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a06f1a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1876044587206656:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789136154.286531:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789136154.286596:0:24916:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789136154.288070:0:23380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587206656 00000100:00100000:0.0:1789136154.288080:0:23380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587206656 00000100:00100000:0.0:1789136154.288114:0:23380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789136154.288129:0:23380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a06f1a5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1876044587206656:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789136154.288154:0:23380:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 692 last 0 00000020:00000080:0.0:1789136154.288187:0:23380:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xedd53ca6b6e47354 00000004:00100000:0.0:1789136154.288201:0:23380:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789136154.288231:0:23380:0:(import.c:65:import_set_state_nolock()) ffff94a08185e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789136154.288295:0:23380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a06f1a5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876044587206656:12345-0@lo:38:llog_process_th.0 Request processed in 166us (1764us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136154.288301:0:23380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000004:3.0:1789136154.288911:0:24916:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1789136154.288925:0:24916:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff94a060014ed8) 00000020:00000080:3.0:1789136154.288942:0:24916:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:3.0:1789136154.289030:0:24916:0:(tgt_mount.c:153:server_get_mount()) get mount ffff94a0660f3000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789136154.289034:0:24916:0:(tgt_mount.c:187:server_put_mount()) put mount ffff94a0660f3000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789136154.289036:0:24916:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94a0660f3000 3 00010000:00080000:3.0:1789136154.289064:0:24916:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94a0819fb000@lustre-MDT0001-lwp-OST0000: add connection 192.168.206.156@tcp at head 00010000:00010000:3.0:1789136154.291235:0:24916:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:3.0:1789136154.293693:0:24916:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1789136154.293751:0:24916:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789136154.293763:0:24916:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xedd53ca6b6e47362 00000100:00080000:3.0:1789136154.293774:0:24916:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789136154.293780:0:24916:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff94a0819fb000 using connection 192.168.206.156@tcp/0@lo 00000100:00100000:3.0:1789136154.293811:0:24916:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff949f42b1de00 x1876044587206784/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789136154.293828:0:24916:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000040:00080000:3.0:1789136154.293983:0:24916:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:0.0:1789136154.295504:0:24888:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1789136154.295541:0:24888:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789136154.295565:0:24888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a0413fc800/0xedd53ca6b6e47338 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e4733f expref: -99 pid: 24888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136154.295577:0:24888:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.156@tcp lock: ffff94a0413fc800/0xedd53ca6b6e47338 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e4733f expref: -99 pid: 24888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789136154.295639:0:24888:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789136154.295642:0:24888:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789136154.295643:0:24888:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789136154.295644:0:24888:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789136154.295646:0:24888:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789136154.295647:0:24888:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789136154.295648:0:24888:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789136154.295650:0:24888:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789136154.295652:0:24888:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789136154.295655:0:24888:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1789136154.295658:0:24888:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789136154.295659:0:24888:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789136154.295660:0:24888:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789136154.295661:0:24888:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789136154.295662:0:24888:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789136154.295663:0:24888:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789136154.295670:0:24888:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789136154.295671:0:24888:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789136154.295671:0:24888:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789136154.295692:0:24888:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789136154.295707:0:24888:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07ad98000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24888:1876044587206912:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789136154.295765:0:24888:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136154.295797:0:24888:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a0512f1600 going to sleep for 11 seconds 00000100:00100000:0.0:1789136154.295821:0:23373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587206912 00000100:00100000:0.0:1789136154.295827:0:23373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587206912 00000100:00100000:0.0:1789136154.295867:0:23373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789136154.295875:0:23373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a076bd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3644072c-bb98-4fbe-9eaf-e40d57d161d0+21:24888:x1876044587206912:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789136154.295900:0:23373:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789136154.295912:0:23373:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1789136154.296461:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f42b1de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1876044587206784:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789136154.296504:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1789136154.296547:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94a06f1a43c0 x1876044587206656/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789136164 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789136154.296557:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789136154.296565:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:2.0:1789136154.296572:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789136154.296577:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789136154.296581:0:3644:0:(import.c:65:import_set_state_nolock()) ffff949f42bab000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789136154.296587:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a06f1a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1876044587206656:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789136154.296622:0:23378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587206784 00000100:00100000:2.0:1789136154.296651:0:23378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587206784 00000100:00100000:2.0:1789136154.296674:0:23378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789136154.296679:0:23378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a06f1a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1876044587206784:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789136154.296701:0:23378:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 692 last 0 00000020:00000080:2.0:1789136154.296733:0:23378:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xedd53ca6b6e47369 00000004:00100000:2.0:1789136154.296748:0:23378:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789136154.296775:0:23378:0:(import.c:65:import_set_state_nolock()) ffff949f42ba8000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789136154.296816:0:23378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a06f1a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876044587206784:12345-0@lo:38:llog_process_th.0 Request processed in 136us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136154.296829:0:23378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1789136154.296874:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff949f42b1de00 x1876044587206784/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789136164 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789136154.296882:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789136154.296886:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:2.0:1789136154.296891:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789136154.296894:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1789136154.296895:0:3644:0:(import.c:65:import_set_state_nolock()) ffff94a0819fb000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789136154.296900:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f42b1de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1876044587206784:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1789136154.305883:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789136154.305889:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789136154.305892:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789136154.305895:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789136154.305922:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789136154.305926:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789136154.305929:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789136154.305932:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789136154.305988:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4416cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876044587207168:0@lo:400:kworker.0 00000100:00100000:1.0:1789136154.306048:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136154.306081:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789136154.306087:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4416c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876044587207040:0@lo:400:kworker.0 00000100:00100000:1.0:1789136154.306112:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136154.306152:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4416c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876044587207296:0@lo:400:kworker.0 00000100:00100000:1.0:1789136154.306175:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136154.306190:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789136154.306194:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4416f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876044587207424:0@lo:400:kworker.0 00000100:00100000:1.0:1789136154.306231:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136154.306261:0:23380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587207168 00000100:00100000:1.0:1789136154.306267:0:23380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587207168 00000100:00100000:1.0:1789136154.306304:0:23380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587207424 00000100:00100000:1.0:1789136154.306308:0:23380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587207424 00000100:00100000:1.0:1789136154.308850:0:23380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789136154.308867:0:23380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f4416de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876044587207168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136154.308946:0:23380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f4416de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876044587207168:12345-0@lo:400:kworker.0 Request processed in 85us (2897us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136154.308953:0:23380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789136154.308970:0:23380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789136154.308975:0:23380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f4416d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876044587207424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136154.309003:0:23380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f4416d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876044587207424:12345-0@lo:400:kworker.0 Request processed in 29us (2773us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136154.309008:0:23380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789136154.309030:0:23383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587207040 00000100:00100000:1.0:1789136154.309036:0:23383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587207040 00000100:00100000:1.0:1789136154.309057:0:23383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587207296 00000100:00100000:1.0:1789136154.309059:0:23383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587207296 00000100:00100000:1.0:1789136154.309071:0:23383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789136154.309076:0:23383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f4416c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876044587207040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136154.309107:0:23383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f4416c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876044587207040:12345-0@lo:400:kworker.0 Request processed in 31us (2994us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136154.309112:0:23383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789136154.309133:0:23383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789136154.309139:0:23383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f4416cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876044587207296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136154.309167:0:23383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f4416cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876044587207296:12345-0@lo:400:kworker.0 Request processed in 28us (2991us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136154.309172:0:23383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789136154.309221:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4416c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876044587207040:0@lo:400:kworker.0 00010000:00080000:1.0:1789136154.309237:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff949f4416cb40 x1876044587207168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136170 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136154.309248:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4416cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876044587207168:0@lo:400:kworker.0 00010000:00080000:1.0:1789136154.309280:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff949f4416f840 x1876044587207424/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136170 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136154.309289:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4416f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876044587207424:0@lo:400:kworker.0 00000100:00100000:1.0:1789136154.309299:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4416c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876044587207296:0@lo:400:kworker.0 20000000:01000000:1.0:1789136154.311927:0:23373:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789136154.311939:0:23373:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1789136154.312004:0:23394:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789136154.312009:0:23394:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789136154.312031:0:23394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff94a07a32c200/0xedd53ca6b6e47370 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136154.312051:0:23394:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94a0429a8000/0xedd53ca6b6e472ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedd53ca6b6e472b3 expref: 21 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136154.312059:0:23394:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94a07a32c600/0xedd53ca6b6e472c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedd53ca6b6e472c1 expref: 21 pid: 23371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136154.312066:0:23394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff94a07a32c200/0xedd53ca6b6e47370 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136154.312109:0:23394:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94a07a32c600/0xedd53ca6b6e472c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xedd53ca6b6e472c1 expref: 21 pid: 23371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136154.312123:0:23394:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94a07a32c600/0xedd53ca6b6e472c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xedd53ca6b6e472c1 expref: 21 pid: 23371 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136154.312138:0:23394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4416c780 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23394:1876044587207552:0@lo:104: 00000100:00100000:1.0:1789136154.312194:0:23394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789136154.312239:0:23394:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94a0429a8000/0xedd53ca6b6e472ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xedd53ca6b6e472b3 expref: 21 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136154.312247:0:23394:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94a0429a8000/0xedd53ca6b6e472ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xedd53ca6b6e472b3 expref: 21 pid: 23373 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136154.312255:0:23394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4416cb40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23394:1876044587207680:0@lo:104: 00000100:00100000:1.0:1789136154.312277:0:23394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136154.312293:0:23394:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a0516a1540 going to sleep for 11 seconds 00000100:00100000:1.0:1789136154.312363:0:23362:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789136154.312378:0:23362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587207552 00000100:00100000:1.0:1789136154.312384:0:23362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587207552 00000100:00100000:1.0:1789136154.312425:0:23362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587207680 00000100:00100000:1.0:1789136154.312428:0:23362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587207680 00000100:00100000:1.0:1789136154.312440:0:23362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789136154.312447:0:23362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f4416f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+4:23394:x1876044587207552:12345-0@lo:104: 00010000:00010000:1.0:1789136154.312459:0:23362:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.156@tcp lock: ffff949f4483c800/0xedd53ca6b6e472c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xedd53ca6b6e472c8 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136154.312501:0:23362:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789136154.312512:0:23362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f4416f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+4:23394:x1876044587207552:12345-0@lo:104: Request processed in 65us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136154.312519:0:23362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789136154.312536:0:23362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789136154.312541:0:23362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a077cfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+3:23394:x1876044587207680:12345-0@lo:104: 00010000:00010000:1.0:1789136154.312549:0:23362:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.156@tcp lock: ffff949f4483c400/0xedd53ca6b6e472b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xedd53ca6b6e472ba expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136154.312580:0:23362:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789136154.312585:0:23362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a077cfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+3:23394:x1876044587207680:12345-0@lo:104: Request processed in 45us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136154.312591:0:23362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789136154.312660:0:23394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4416c780 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23394:1876044587207552:0@lo:104: 00000100:00100000:1.0:1789136154.312670:0:23394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4416cb40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23394:1876044587207680:0@lo:104: 00010000:00010000:1.0:1789136154.312686:0:23394:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff94a07a32c200/0xedd53ca6b6e47370 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136154.312704:0:23367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789136154.312709:0:23367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.156@tcp lock: ffff949f4483c800/0xedd53ca6b6e472c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xedd53ca6b6e472c8 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136154.312717:0:23367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff949f4483c800 already unused, calling callback (ffffffffc13c2c20) 10000000:00010000:1.0:1789136154.312721:0:23367:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.156@tcp lock: ffff949f4483c800/0xedd53ca6b6e472c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xedd53ca6b6e472c8 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136154.313010:0:23367:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.156@tcp lock: ffff949f4483c800/0xedd53ca6b6e472c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xedd53ca6b6e472c8 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789136154.313021:0:23367:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.156@tcp lock: ffff949f4483c800/0xedd53ca6b6e472c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xedd53ca6b6e472c8 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789136154.313035:0:23367:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789136154.313067:0:23367:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.156@tcp lock: ffff949f4483c800/0xedd53ca6b6e472c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedd53ca6b6e472c8 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136154.313074:0:23367:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789136154.313091:0:23367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.156@tcp lock: ffff949f4483c800/0xedd53ca6b6e472c1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedd53ca6b6e472c8 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136154.313098:0:23367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.156@tcp lock: ffff949f4483c800/0xedd53ca6b6e472c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedd53ca6b6e472c8 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136154.313110:0:23367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789136154.313113:0:23367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.156@tcp lock: ffff949f4483c400/0xedd53ca6b6e472b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xedd53ca6b6e472ba expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136154.313118:0:23367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff949f4483c400 already unused, calling callback (ffffffffc13c2c20) 10000000:00010000:1.0:1789136154.313120:0:23367:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.156@tcp lock: ffff949f4483c400/0xedd53ca6b6e472b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xedd53ca6b6e472ba expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136154.313125:0:23367:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.156@tcp lock: ffff949f4483c400/0xedd53ca6b6e472b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xedd53ca6b6e472ba expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789136154.313131:0:23367:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.156@tcp lock: ffff949f4483c400/0xedd53ca6b6e472b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xedd53ca6b6e472ba expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789136154.313135:0:23367:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789136154.313145:0:23367:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.156@tcp lock: ffff949f4483c400/0xedd53ca6b6e472b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedd53ca6b6e472ba expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136154.313151:0:23367:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789136154.313164:0:23367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.156@tcp lock: ffff949f4483c400/0xedd53ca6b6e472b3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedd53ca6b6e472ba expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136154.313169:0:23367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.156@tcp lock: ffff949f4483c400/0xedd53ca6b6e472b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedd53ca6b6e472ba expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136154.313180:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136154.313182:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136154.313184:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136154.313191:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789136154.313250:0:23373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a076bd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3644072c-bb98-4fbe-9eaf-e40d57d161d0+21:24888:x1876044587206912:12345-0@lo:253:mount.lustre.0 Request processed in 17375us (17484us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136154.313257:0:23373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789136154.313292:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4416cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3644072c-bb98-4fbe-9eaf-e40d57d161d0:3645:1876044587207808:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789136154.313338:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136154.313361:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789136154.313366:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4416c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3644072c-bb98-4fbe-9eaf-e40d57d161d0:3645:1876044587207936:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789136154.313388:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136154.313588:0:24888:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07ad98000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:24888:1876044587206912:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789136154.313599:0:24888:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789136154.313602:0:24888:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789136154.313603:0:24888:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789136154.313605:0:24888:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789136154.313606:0:24888:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789136154.313607:0:24888:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789136154.313608:0:24888:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789136154.313609:0:24888:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789136154.313611:0:24888:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789136154.313612:0:24888:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789136154.313622:0:24888:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1789136154.314854:0:23365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587207808 00000100:00100000:1.0:1789136154.314864:0:23365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587207808 00010000:00010000:1.0:1789136154.314894:0:23365:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94a07a32c600/0xedd53ca6b6e472c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedd53ca6b6e472c1 expref: 21 pid: 23371 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136154.314925:0:23365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587207936 00000100:00100000:1.0:1789136154.314927:0:23365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587207936 00010000:00010000:1.0:1789136154.314938:0:23365:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94a0429a8000/0xedd53ca6b6e472ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedd53ca6b6e472b3 expref: 22 pid: 23373 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136154.314950:0:23365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789136154.314956:0:23365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f4416f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3644072c-bb98-4fbe-9eaf-e40d57d161d0+22:3645:x1876044587207808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789136154.314977:0:23365:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789136154.314982:0:23365:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94a07a32c600/0xedd53ca6b6e472c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedd53ca6b6e472c1 expref: 22 pid: 23371 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136154.314992:0:23365:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94a07a32c600/0xedd53ca6b6e472c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xedd53ca6b6e472c1 expref: 22 pid: 23371 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136154.315006:0:23365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94a07a32c600/0xedd53ca6b6e472c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xedd53ca6b6e472c1 expref: 22 pid: 23371 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136154.315018:0:23365:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789136154.315066:0:23365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f4416f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3644072c-bb98-4fbe-9eaf-e40d57d161d0+21:3645:x1876044587207808:12345-0@lo:103:ldlm_bl.0 Request processed in 110us (1728us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136154.315073:0:23365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789136154.315088:0:23365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789136154.315093:0:23365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0490c9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3644072c-bb98-4fbe-9eaf-e40d57d161d0+20:3645:x1876044587207936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789136154.315099:0:23365:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789136154.315103:0:23365:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94a0429a8000/0xedd53ca6b6e472ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedd53ca6b6e472b3 expref: 20 pid: 23373 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136154.315109:0:23365:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94a0429a8000/0xedd53ca6b6e472ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xedd53ca6b6e472b3 expref: 20 pid: 23373 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136154.315118:0:23365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94a0429a8000/0xedd53ca6b6e472ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xedd53ca6b6e472b3 expref: 20 pid: 23373 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136154.315129:0:23365:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff94a07a32c200/0xedd53ca6b6e47370 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136154.315137:0:23365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94a07a32c200/0xedd53ca6b6e47370 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789136154.315157:0:23365:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.013081833s 00010000:00010000:1.0:1789136154.315161:0:23365:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94a07a32c200/0xedd53ca6b6e47370 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136154.315168:0:23365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94a07a32c200/0xedd53ca6b6e47370 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136154.315174:0:23365:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff94a07a32c200/0xedd53ca6b6e47370 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136154.315179:0:23365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff94a07a32c200/0xedd53ca6b6e47370 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136154.315184:0:23365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a07a32c200 already unused, calling callback (ffffffffc0d90550) 00010000:00010000:1.0:1789136154.315188:0:23365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff94a07a32c200/0xedd53ca6b6e47370 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136154.315195:0:23365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff94a07a32c200/0xedd53ca6b6e47370 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136154.315207:0:23365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff94a07a32c200/0xedd53ca6b6e47370 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136154.315215:0:23365:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789136154.315237:0:23365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0490c9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3644072c-bb98-4fbe-9eaf-e40d57d161d0+19:3645:x1876044587207936:12345-0@lo:103:ldlm_bl.0 Request processed in 144us (1848us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136154.315244:0:23365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1789136154.315289:0:23394:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff94a07a32c200/0xedd53ca6b6e47370 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136154.315306:0:23394:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff94a07a32c200/0xedd53ca6b6e47370 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136154.315312:0:23394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94a07a32c200/0xedd53ca6b6e47370 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136154.315861:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4416c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3644072c-bb98-4fbe-9eaf-e40d57d161d0:3645:1876044587207936:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789136154.315871:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4416cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3644072c-bb98-4fbe-9eaf-e40d57d161d0:3645:1876044587207808:0@lo:103:ldlm_bl.0 00000001:00000004:1.0:1789136154.319754:0:24888:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:2.0:1789136154.324981:0:24888:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1789136154.324990:0:24888:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1789136154.325029:0:24888:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789136154.325073:0:24888:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.156@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789136154.325090:0:24888:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1789136154.325115:0:24888:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1789136154.331164:0:24888:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789136154.332902:0:24888:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789136154.932359:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789136155.185315:0:24971:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789136155.185573:0:24971:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1789136155.632844:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789136155.632875:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f42b1fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876044587208064:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789136155.632935:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136155.632986:0:23383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587208064 00000100:00100000:2.0:1789136155.632992:0:23383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587208064 00000100:00100000:2.0:1789136155.633029:0:23383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789136155.633037:0:23383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a06f1a43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876044587208064:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789136155.633067:0:23383:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789136155.633108:0:23383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a06f1a43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876044587208064:12345-0@lo:41:osp-pre-1-0.0 Request processed in 72us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136155.633124:0:23383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789136155.633179:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f42b1fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876044587208064:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789136155.635244:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789136155.635261:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f42b1f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876044587208192:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789136155.635326:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136155.635408:0:24123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587208192 00000100:00100000:1.0:1789136155.635416:0:24123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587208192 00000100:00100000:1.0:1789136155.635464:0:24123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789136155.635474:0:24123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f42b1d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876044587208192:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789136155.635514:0:24123:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789136155.635563:0:24123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f42b1d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876044587208192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136155.635570:0:24123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789136155.635610:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f42b1f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876044587208192:0@lo:41:osp-pre-0-1.0 10000000:01000000:1.0:1789136155.696720:0:23375:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789136155.696728:0:23375:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff949f43b2f800 from 13 10000000:01000000:1.0:1789136155.696734:0:23375:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789136155.696776:0:23375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a07a32c800/0xedd53ca6b6e47377 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136155.696787:0:23375:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.156@tcp lock: ffff94a07a32c800/0xedd53ca6b6e47377 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136155.696805:0:23375:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.156@tcp lock: ffff94a07a32c800/0xedd53ca6b6e47377 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136155.696829:0:23375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4416cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23375:1876044587208320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789136155.696890:0:23375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136155.696929:0:23375:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a0516a1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789136155.697051:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587208320 00000100:00100000:0.0:1789136155.697058:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587208320 00000100:00100000:0.0:1789136155.697109:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789136155.697118:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a076bd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+19:23375:x1876044587208320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789136155.697131:0:23372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136155.697144:0:23372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94a0413fd400/0xedd53ca6b6e4737e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xedd53ca6b6e47377 expref: -99 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136155.697178:0:23372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94a0413fd400/0xedd53ca6b6e4737e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedd53ca6b6e47377 expref: 20 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136155.697189:0:23372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94a0413fd400/0xedd53ca6b6e4737e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedd53ca6b6e47377 expref: 20 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136155.697197:0:23372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94a0413fd400, rc 0) 00000100:00100000:0.0:1789136155.697246:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a076bd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+20:23375:x1876044587208320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136155.697254:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789136155.697353:0:23375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4416cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23375:1876044587208320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789136155.697366:0:23375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.156@tcp lock: ffff94a07a32c800/0xedd53ca6b6e47377 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e4737e expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136155.697374:0:23375:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.156@tcp lock: ffff94a07a32c800/0xedd53ca6b6e47377 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xedd53ca6b6e4737e expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136155.697419:0:23375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4416cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23375:1876044587208448:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789136155.697445:0:23375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136155.697465:0:23375:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a0516a1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789136155.697918:0:23373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587208448 00000100:00100000:0.0:1789136155.697923:0:23373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587208448 00000100:00100000:0.0:1789136155.697959:0:23373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789136155.697966:0:23373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a076bd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3644072c-bb98-4fbe-9eaf-e40d57d161d0+20:23375:x1876044587208448:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789136155.697980:0:23373:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789136155.697994:0:23373:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789136155.697997:0:23373:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:0.0:1789136155.698079:0:23373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a076bd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3644072c-bb98-4fbe-9eaf-e40d57d161d0+20:23375:x1876044587208448:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 113us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136155.698086:0:23373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789136155.698457:0:23375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4416cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23375:1876044587208448:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789136155.698522:0:23375:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.156@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789136155.698530:0:23375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a07a32c800/0xedd53ca6b6e47377 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e4737e expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136155.698539:0:23375:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.156@tcp lock: ffff94a07a32c800/0xedd53ca6b6e47377 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e4737e expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789136155.698549:0:23375:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789136155.698551:0:23375:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff949f449ce800 from 13 10000000:01000000:2.0:1789136155.698554:0:23375:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789136155.698577:0:23375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a0429a8000/0xedd53ca6b6e47385 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136155.698584:0:23375:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.156@tcp lock: ffff94a0429a8000/0xedd53ca6b6e47385 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136155.698591:0:23375:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.156@tcp lock: ffff94a0429a8000/0xedd53ca6b6e47385 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136155.698606:0:23375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a06f1a7840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23375:1876044587208576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789136155.698665:0:23375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136155.698748:0:23375:0:(client.c:2715:ptlrpc_set_wait()) set ffff949f428facc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789136155.705953:0:23371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587208576 00000100:00100000:1.0:1789136155.705967:0:23371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587208576 00000100:00100000:1.0:1789136155.706029:0:23371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789136155.706042:0:23371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a076bd0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+20:23375:x1876044587208576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789136155.706067:0:23371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789136155.706087:0:23371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94a07a32dc00/0xedd53ca6b6e4738c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xedd53ca6b6e47385 expref: -99 pid: 23371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136155.706115:0:23371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94a07a32dc00/0xedd53ca6b6e4738c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedd53ca6b6e47385 expref: 21 pid: 23371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136155.706141:0:23371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94a07a32dc00/0xedd53ca6b6e4738c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedd53ca6b6e47385 expref: 21 pid: 23371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136155.706152:0:23371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94a07a32dc00, rc 0) 00000100:00100000:1.0:1789136155.706230:0:23371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a076bd0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+21:23375:x1876044587208576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 191us (7563us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136155.706238:0:23371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789136155.706471:0:23375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a06f1a7840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23375:1876044587208576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789136155.706503:0:23375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.156@tcp lock: ffff94a0429a8000/0xedd53ca6b6e47385 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e4738c expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136155.706520:0:23375:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.156@tcp lock: ffff94a0429a8000/0xedd53ca6b6e47385 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xedd53ca6b6e4738c expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136155.706578:0:23375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a06f1a7840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23375:1876044587208704:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789136155.706616:0:23375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136155.706672:0:23375:0:(client.c:2715:ptlrpc_set_wait()) set ffff949f428facc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789136155.707093:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587208704 00000100:00100000:1.0:1789136155.707098:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587208704 00000100:00100000:1.0:1789136155.707140:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789136155.707148:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a076bd0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+21:23375:x1876044587208704:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789136155.707164:0:23372:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789136155.707179:0:23372:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789136155.707182:0:23372:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:1.0:1789136155.707269:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a076bd0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+21:23375:x1876044587208704:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 121us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136155.707276:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789136155.708203:0:23375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a06f1a7840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23375:1876044587208704:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789136155.708355:0:23375:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.156@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789136155.708364:0:23375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a0429a8000/0xedd53ca6b6e47385 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e4738c expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136155.708385:0:23375:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.156@tcp lock: ffff94a0429a8000/0xedd53ca6b6e47385 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e4738c expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136155.957102:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136156.977964:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136158.000950:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789136158.385388:0:23417:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789136159.031026:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789136159.732372:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789136159.732378:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789136159.732381:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789136159.732384:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789136159.732409:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789136159.732425:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789136159.732428:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789136159.732431:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789136159.732476:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07ad9b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3644072c-bb98-4fbe-9eaf-e40d57d161d0:3645:1876044587208832:0@lo:400:kworker.0 00000100:00100000:0.0:1789136159.732547:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136159.732591:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07ad983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876044587209344:0@lo:400:kworker.0 00000100:00100000:0.0:1789136159.732615:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136159.732662:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789136159.732668:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07ad98b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876044587208960:0@lo:400:kworker.0 00000100:00100000:0.0:1789136159.732692:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136159.732711:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07ad9a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876044587209472:0@lo:400:kworker.0 00000100:00100000:0.0:1789136159.732734:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136159.732761:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07ad98780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876044587209088:0@lo:400:kworker.0 00000100:00100000:0.0:1789136159.732781:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136159.732796:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07ad992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876044587209600:0@lo:400:kworker.0 00000100:00100000:0.0:1789136159.732816:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136159.732829:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789136159.732834:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07ad9ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876044587209216:0@lo:400:kworker.0 00000100:00100000:0.0:1789136159.732851:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136159.732876:0:23371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587208832 00000100:00100000:0.0:1789136159.732882:0:23371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587208832 00000100:00100000:0.0:1789136159.732920:0:23371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789136159.732928:0:23371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a049033c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+21:3645:x1876044587208832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136159.732967:0:23371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a049033c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+21:3645:x1876044587208832:12345-0@lo:400:kworker.0 Request processed in 40us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136159.732980:0:23371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789136159.733008:0:23380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587209344 00000100:00100000:0.0:1789136159.733011:0:23380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587209344 00000100:00100000:0.0:1789136159.733026:0:23380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587209472 00000100:00100000:0.0:1789136159.733028:0:23380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587209472 00000100:00100000:0.0:1789136159.733044:0:23380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587209088 00000100:00100000:0.0:1789136159.733047:0:23380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587209088 00000100:00100000:0.0:1789136159.733055:0:23380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587209600 00000100:00100000:0.0:1789136159.733057:0:23380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587209600 00000100:00100000:0.0:1789136159.733068:0:23380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789136159.733073:0:23380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a07ad9a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876044587209344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136159.733100:0:23380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a07ad9a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876044587209344:12345-0@lo:400:kworker.0 Request processed in 26us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136159.733105:0:23380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789136159.733114:0:23380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789136159.733119:0:23380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a04373b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876044587209472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136159.733138:0:23380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a04373b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876044587209472:12345-0@lo:400:kworker.0 Request processed in 19us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136159.733144:0:23380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789136159.733152:0:23380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789136159.734271:0:23380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a043738000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876044587209088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136159.734363:0:23380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a043738000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876044587209088:12345-0@lo:400:kworker.0 Request processed in 1205us (1579us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136159.734372:0:23380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789136159.734395:0:23380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789136159.734404:0:23380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a04373b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876044587209600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136159.734450:0:23380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a04373b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876044587209600:12345-0@lo:400:kworker.0 Request processed in 48us (1633us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136159.734456:0:23380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789136159.734485:0:23384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587208960 00000100:00100000:0.0:1789136159.734491:0:23384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587208960 00000100:00100000:0.0:1789136159.734523:0:23384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587209216 00000100:00100000:0.0:1789136159.734526:0:23384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587209216 00000100:00100000:0.0:1789136159.734539:0:23384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789136159.734545:0:23384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a043739680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876044587208960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136159.734575:0:23384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a043739680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876044587208960:12345-0@lo:400:kworker.0 Request processed in 30us (1881us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136159.734580:0:23384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789136159.734590:0:23384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789136159.734595:0:23384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a043738780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876044587209216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136159.734617:0:23384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a043738780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876044587209216:12345-0@lo:400:kworker.0 Request processed in 22us (1765us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136159.734622:0:23384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1789136159.734677:0:23374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789136159.734681:0:23374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789136159.734709:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07ad9ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876044587209216:0@lo:400:kworker.0 00010000:00080000:0.0:1789136159.734723:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94a07ad98780 x1876044587209088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136175 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136159.734732:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07ad98780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876044587209088:0@lo:400:kworker.0 00010000:00080000:0.0:1789136159.734741:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94a07ad992c0 x1876044587209600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136175 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136159.734765:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07ad992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876044587209600:0@lo:400:kworker.0 00000100:00100000:0.0:1789136159.734806:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07ad98b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876044587208960:0@lo:400:kworker.0 00010000:00080000:0.0:1789136159.734817:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94a07ad9a1c0 x1876044587209472/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136175 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136159.734826:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07ad9a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876044587209472:0@lo:400:kworker.0 00000100:00100000:0.0:1789136159.734834:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07ad9b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3644072c-bb98-4fbe-9eaf-e40d57d161d0:3645:1876044587208832:0@lo:400:kworker.0 00010000:00080000:0.0:1789136159.734844:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94a07ad983c0 x1876044587209344/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136175 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136159.734852:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07ad983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876044587209344:0@lo:400:kworker.0 00010000:00010000:3.0:1789136160.048798:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789136160.756464:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f42b1c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876044587209856:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789136160.756579:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136160.757050:0:23384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587209856 00000100:00100000:3.0:1789136160.757061:0:23384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587209856 00000100:00100000:3.0:1789136160.757134:0:23384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789136160.757159:0:23384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a06f1a61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876044587209856:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789136160.757208:0:23384:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789136160.757280:0:23384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a06f1a61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876044587209856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 124us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136160.757300:0:23384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789136160.757357:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f42b1c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876044587209856:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789136160.759275:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a06f1a4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876044587209728:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789136160.759356:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136160.763770:0:23383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587209728 00000100:00100000:3.0:1789136160.763784:0:23383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587209728 00000100:00100000:3.0:1789136160.763844:0:23383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789136160.763853:0:23383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0437383c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876044587209728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789136160.763890:0:23383:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1789136160.763986:0:23383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0437383c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876044587209728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 134us (4629us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136160.763994:0:23383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789136160.764052:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a06f1a4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876044587209728:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789136161.073795:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789136161.151523:0:25262:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg656-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789136162.096880:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789136162.153437:0:25314:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789136162.153864:0:25314:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:0.0:1789136162.675805:0:24136:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:1.0:1789136163.104171:0:25365:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789136163.104984:0:25365:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789136163.121448:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136164.149951:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789136164.848805:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789136164.848811:0:479:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789136164.848816:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4416c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3644072c-bb98-4fbe-9eaf-e40d57d161d0:3646:1876044587209984:0@lo:400:kworker.0 00000100:00080000:1.0:1789136164.848822:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789136164.848825:0:479:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789136164.848841:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789136164.848844:0:479:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789136164.848846:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789136164.848848:0:479:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789136164.848878:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136164.848879:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4416cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876044587210368:0@lo:400:kworker.0 00000100:00100000:1.0:1789136164.848910:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136164.848927:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a060d33c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876044587210496:0@lo:400:kworker.0 00000100:00100000:1.0:1789136164.848951:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4416c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876044587210112:0@lo:400:kworker.0 00000100:00100000:0.0:1789136164.848952:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136164.848973:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136164.848988:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a076a2c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876044587210624:0@lo:400:kworker.0 00000100:00100000:0.0:1789136164.849005:0:23373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587209984 00000100:00100000:1.0:1789136164.849010:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136164.849011:0:23373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587209984 00000100:00100000:1.0:1789136164.849025:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789136164.849030:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4416f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876044587210240:0@lo:400:kworker.0 00000100:00100000:1.0:1789136164.849049:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136164.849051:0:23373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789136164.849059:0:23373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a049032c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3644072c-bb98-4fbe-9eaf-e40d57d161d0+21:3646:x1876044587209984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136164.849062:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a076a2ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876044587210752:0@lo:400:kworker.0 00000100:00100000:1.0:1789136164.849080:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136164.849100:0:23373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a049032c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3644072c-bb98-4fbe-9eaf-e40d57d161d0+21:3646:x1876044587209984:12345-0@lo:400:kworker.0 Request processed in 42us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136164.849105:0:24123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587210368 00000100:00100000:1.0:1789136164.849109:0:24123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587210368 00000100:00100000:0.0:1789136164.849112:0:23373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789136164.849131:0:24123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587210112 00000100:00100000:1.0:1789136164.849133:0:24123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587210112 00000100:00100000:1.0:1789136164.849146:0:24123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789136164.849152:0:24123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a076a2de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876044587210368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136164.849152:0:23380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587210496 00000100:00100000:0.0:1789136164.849155:0:23380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587210496 00000100:00100000:0.0:1789136164.849170:0:23380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587210624 00000100:00100000:0.0:1789136164.849173:0:23380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587210624 00000100:00100000:1.0:1789136164.849187:0:24123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a076a2de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876044587210368:12345-0@lo:400:kworker.0 Request processed in 35us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136164.849191:0:23380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587210240 00000100:00100000:0.0:1789136164.849194:0:23380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587210240 00000100:00100000:1.0:1789136164.849199:0:24123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789136164.849211:0:24123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789136164.849217:0:24123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a076a2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876044587210112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136164.849223:0:23380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587210752 00000100:00100000:0.0:1789136164.849225:0:23380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587210752 00000100:00100000:0.0:1789136164.849238:0:23380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789136164.849244:0:23380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a04373bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876044587210496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136164.849248:0:24123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a076a2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876044587210112:12345-0@lo:400:kworker.0 Request processed in 32us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136164.849254:0:24123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789136164.849282:0:23380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a04373bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876044587210496:12345-0@lo:400:kworker.0 Request processed in 38us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136164.849288:0:23380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789136164.849291:0:23379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789136164.849297:0:23379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a076a2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876044587210624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136164.849298:0:23380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789136164.849303:0:23380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a076a2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876044587210240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136164.849323:0:23379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a076a2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876044587210624:12345-0@lo:400:kworker.0 Request processed in 27us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136164.849323:0:23380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a076a2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876044587210240:12345-0@lo:400:kworker.0 Request processed in 20us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136164.849329:0:23380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789136164.850977:0:23379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789136164.851016:0:23379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789136164.851031:0:23379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a076a2e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876044587210752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136164.851475:0:23379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a076a2e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876044587210752:12345-0@lo:400:kworker.0 Request processed in 451us (2392us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136164.851482:0:23379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789136164.851540:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4416cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876044587210368:0@lo:400:kworker.0 00010000:00080000:1.0:1789136164.851578:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff949f4416f840 x1876044587210240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136180 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136164.851590:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4416f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876044587210240:0@lo:400:kworker.0 00010000:00080000:1.0:1789136164.851602:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94a076a2ed00 x1876044587210752/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136180 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136164.851610:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a076a2ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876044587210752:0@lo:400:kworker.0 00000100:00100000:1.0:1789136164.851656:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4416c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876044587210112:0@lo:400:kworker.0 00010000:00080000:1.0:1789136164.851666:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94a076a2c780 x1876044587210624/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136180 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136164.851674:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a076a2c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876044587210624:0@lo:400:kworker.0 00000100:00080000:0.0:1789136164.852039:0:23374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789136164.852044:0:23374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789136164.852066:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94a060d33c00 x1876044587210496/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136180 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136164.852078:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a060d33c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876044587210496:0@lo:400:kworker.0 00000100:00100000:0.0:1789136164.852089:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4416c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3644072c-bb98-4fbe-9eaf-e40d57d161d0:3646:1876044587209984:0@lo:400:kworker.0 00010000:00010000:1.0:1789136165.171998:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136165.558726:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789136150/real 1789136150] req@ffff94a043739a40 x1876044587202816/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789136165 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136165.558756:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff94a043739a40 x1876044587202816/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789136165 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136165.558767:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789136150/real 1789136150] req@ffff94a04373a1c0 x1876044587202944/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789136165 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136165.558777:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff94a04373a1c0 x1876044587202944/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789136165 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789136165.558797:0:3644:0:(import.c:65:import_set_state_nolock()) ffff949f42648800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789136165.558815:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789136165.558819:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a043739a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876044587202816:0@lo:8:kworker.0 00000100:00080000:3.0:1789136165.558823:0:3644:0:(import.c:65:import_set_state_nolock()) ffff94a07021d000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789136165.558828:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789136165.558831:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a04373a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876044587202944:0@lo:8:kworker.0 00000100:00080000:3.0:1789136165.558907:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789136165.558911:0:479:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789136165.558913:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789136165.558916:0:479:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789136165.558939:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789136165.558941:0:479:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789136165.558943:0:479:0:(import.c:65:import_set_state_nolock()) ffff949f42648800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789136165.558948:0:479:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 688 00000100:00080000:3.0:1789136165.558964:0:479:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789136165.558970:0:479:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff949f42648800 using connection 192.168.206.156@tcp/0@lo 00000100:00100000:3.0:1789136165.558990:0:479:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff949f42b1f840 x1876044587211392/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789136165.559003:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789136165.559005:0:479:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789136165.559007:0:479:0:(import.c:65:import_set_state_nolock()) ffff94a07021d000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789136165.559010:0:479:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 688 00000100:00080000:3.0:1789136165.559012:0:479:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789136165.559015:0:479:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff94a07021d000 using connection 192.168.206.156@tcp/0@lo 00000100:00100000:3.0:1789136165.559026:0:479:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff949f42b1fc00 x1876044587211520/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789136165.559066:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f42b1c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3644072c-bb98-4fbe-9eaf-e40d57d161d0:3645:1876044587210880:0@lo:400:kworker.0 00000100:00100000:3.0:1789136165.559136:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136165.559172:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f42b1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876044587211648:0@lo:400:kworker.0 00000100:00100000:3.0:1789136165.559198:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136165.559220:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789136165.559226:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f42b1d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876044587211008:0@lo:400:kworker.0 00000100:00100000:3.0:1789136165.559385:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136165.559411:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f42b1de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876044587211776:0@lo:400:kworker.0 00000100:00100000:3.0:1789136165.559438:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136165.559465:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f42b1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876044587211136:0@lo:400:kworker.0 00000100:00100000:3.0:1789136165.559487:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136165.559503:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f42b1e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876044587211904:0@lo:400:kworker.0 00000100:00100000:3.0:1789136165.559536:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136165.559556:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789136165.559562:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f42b1c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876044587211264:0@lo:400:kworker.0 00000100:00100000:3.0:1789136165.559583:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136165.559611:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f42b1f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876044587211392:0@lo:8:kworker.0 00000100:00100000:3.0:1789136165.559669:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136165.559691:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f42b1fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876044587211520:0@lo:8:kworker.0 00000100:00100000:3.0:1789136165.559709:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136165.559737:0:23379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587211648 00000100:00100000:3.0:1789136165.559744:0:23379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587211648 00000100:00100000:3.0:1789136165.559778:0:23379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587211776 00000100:00100000:3.0:1789136165.559781:0:23379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587211776 00000100:00100000:3.0:1789136165.559792:0:23379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587211136 00000100:00100000:3.0:1789136165.559795:0:23379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587211136 00000100:00100000:3.0:1789136165.559804:0:23379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587211904 00000100:00100000:3.0:1789136165.559806:0:23379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587211904 00000100:00100000:3.0:1789136165.559818:0:23379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789136165.559825:0:23379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f42b1cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876044587211648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136165.559870:0:23379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f42b1cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876044587211648:12345-0@lo:400:kworker.0 Request processed in 45us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136165.559877:0:23379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789136165.559893:0:23379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789136165.559898:0:23379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f44368b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876044587211776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136165.559924:0:23379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f44368b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876044587211776:12345-0@lo:400:kworker.0 Request processed in 27us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136165.559930:0:23379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789136165.559940:0:23379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789136165.559954:0:23379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f443692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876044587211136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136165.559987:0:23379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f443692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876044587211136:12345-0@lo:400:kworker.0 Request processed in 35us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136165.559993:0:23379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789136165.560005:0:23379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789136165.560011:0:23379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f4436b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876044587211904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136165.560038:0:23379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f4436b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876044587211904:12345-0@lo:400:kworker.0 Request processed in 28us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136165.560044:0:23379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789136165.560062:0:24123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587211008 00000100:00100000:3.0:1789136165.560065:0:24123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587211008 00000100:00100000:0.0:1789136165.560205:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587210880 00000100:00100000:0.0:1789136165.560215:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587210880 00000100:00100000:0.0:1789136165.560244:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789136165.560251:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a049030050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+21:3645:x1876044587210880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136165.560370:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a049030050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+21:3645:x1876044587210880:12345-0@lo:400:kworker.0 Request processed in 120us (1234us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136165.560376:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789136165.561074:0:24123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587211264 00000100:00100000:3.0:1789136165.562312:0:24123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587211264 00000100:00100000:3.0:1789136165.562357:0:24123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789136165.562367:0:24123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f4436a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876044587211008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136165.562445:0:24123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f4436a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876044587211008:12345-0@lo:400:kworker.0 Request processed in 80us (3191us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136165.562452:0:24123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789136165.562468:0:24123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789136165.562474:0:24123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f4436a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876044587211264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136165.562505:0:24123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f4436a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876044587211264:12345-0@lo:400:kworker.0 Request processed in 31us (2920us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136165.562510:0:24123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789136165.562554:0:24892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587211392 00000100:00100000:3.0:1789136165.562558:0:24892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587211392 00000100:00100000:3.0:1789136165.562578:0:24892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587211520 00000100:00100000:3.0:1789136165.562581:0:24892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587211520 00000100:00100000:3.0:1789136165.562600:0:24892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789136165.562604:0:24892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f44369e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3644:x1876044587211392:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789136165.562650:0:24892:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 703 last 0 00000020:00000080:3.0:1789136165.562677:0:24892:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xedd53ca6b6e47393 00002000:00100000:3.0:1789136165.562691:0:24892:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff94a0819fc800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113983 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1789136165.562695:0:24892:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:3.0:1789136165.562697:0:24892:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789136165.562867:0:24892:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1789136165.562890:0:24892:0:(import.c:65:import_set_state_nolock()) ffff94a0819ff000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789136165.562931:0:24892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f44369e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3644:x1876044587211392:12345-0@lo:8:kworker.0 Request processed in 326us (3261us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136165.562938:0:24892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789136165.562951:0:24892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789136165.562955:0:24892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f4436a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3644:x1876044587211520:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1789136165.562966:0:24892:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789136165.576242:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f42b1c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876044587211264:0@lo:400:kworker.0 00010000:00080000:2.0:1789136165.576273:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff949f42b1f480 x1876044587211136/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136181 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789136165.576285:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f42b1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876044587211136:0@lo:400:kworker.0 00010000:00080000:2.0:1789136165.576298:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff949f42b1e580 x1876044587211904/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136181 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789136165.576306:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f42b1e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876044587211904:0@lo:400:kworker.0 00000100:00100000:2.0:1789136165.576349:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f42b1d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876044587211008:0@lo:400:kworker.0 00010000:00080000:2.0:1789136165.576361:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff949f42b1de00 x1876044587211776/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136181 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789136165.576370:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f42b1de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876044587211776:0@lo:400:kworker.0 00000100:00100000:2.0:1789136165.576396:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f42b1c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3644072c-bb98-4fbe-9eaf-e40d57d161d0:3645:1876044587210880:0@lo:400:kworker.0 00010000:00080000:2.0:1789136165.576408:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff949f42b1c000 x1876044587211648/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136181 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789136165.576416:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f42b1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876044587211648:0@lo:400:kworker.0 00010000:00080000:2.0:1789136165.589902:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff949f42b1f840 x1876044587211392/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789136185 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789136165.589918:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789136165.589927:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1789136165.589936:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789136165.589942:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1789136165.589945:0:3644:0:(import.c:65:import_set_state_nolock()) ffff949f42648800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789136165.589967:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789136165.589973:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f42b1f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876044587211392:0@lo:8:kworker.0 00000004:00080000:0.0:1789136165.590419:0:24125:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1789136165.590442:0:24125:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a043739a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:24125:1876044587212160:0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1789136165.590502:0:24125:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136165.590528:0:24125:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a0431280c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789136165.590540:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a04373a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876044587212032:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789136165.590564:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136165.590597:0:24895:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1789136165.590604:0:24895:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1789136165.590959:0:24895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587212160 00000100:00100000:0.0:1789136165.590966:0:24895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587212160 00000100:00080000:0.0:1789136165.591010:0:23374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789136165.591080:0:25476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789136165.591090:0:25476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a043738b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:24125:x1876044587212160:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:2.0:1789136165.591387:0:24896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587212032 00000100:00100000:2.0:1789136165.591391:0:24896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587212032 00000100:00100000:2.0:1789136165.591423:0:24896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789136165.591431:0:24896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a060d33c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3648:x1876044587212032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789136165.591449:0:24896:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915845632 avail 3684323328 00000100:00100000:2.0:1789136165.591505:0:24896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a060d33c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3648:x1876044587212032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (940us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136165.591513:0:24896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789136165.591550:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94a04373a1c0 x1876044587212032/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789136181 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789136165.591568:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a04373a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876044587212032:0@lo:13:osp-pre-0-1.0 00000004:00080000:0.0:1789136165.596230:0:24124:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789136165.596338:0:24124:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 703690709214ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789136165.596346:0:24124:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00002000:00080000:0.0:1789136165.598036:0:25476:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1789136165.598044:0:25476:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:0.0:1789136165.598209:0:25476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a043738b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:24125:x1876044587212160:12345-0@lo:7:osp-pre-0-1.0 Request processed in 7116us (7701us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136165.598221:0:25476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789136165.598365:0:24125:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94a043739a40 x1876044587212160/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789136181 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136165.598381:0:24125:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a043739a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:24125:1876044587212160:0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1789136165.598394:0:24125:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:1.0:1789136165.598432:0:24125:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a076a2c780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:24125:1876044587212288:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1789136165.598468:0:24125:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136165.598492:0:24125:0:(client.c:2715:ptlrpc_set_wait()) set ffff949f429dd300 going to sleep for 11 seconds 00000100:00100000:1.0:1789136165.598513:0:24895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587212288 00000100:00100000:1.0:1789136165.598519:0:24895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587212288 00000100:00100000:1.0:1789136165.598554:0:24895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789136165.598562:0:24895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a076a2ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:24125:x1876044587212288:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1789136165.598585:0:24895:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:1.0:1789136165.598616:0:24895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a076a2ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:24125:x1876044587212288:12345-0@lo:5:osp-pre-0-1.0 Request processed in 55us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136165.598623:0:24895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789136165.598670:0:24125:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94a076a2c780 x1876044587212288/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789136181 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136165.598681:0:24125:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a076a2c780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:24125:1876044587212288:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1789136165.598689:0:24125:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:1.0:1789136165.598724:0:24125:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a076a2c780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:24125:1876044587212416:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1789136165.598746:0:24125:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136165.598759:0:24125:0:(client.c:2715:ptlrpc_set_wait()) set ffff949f429dd300 going to sleep for 11 seconds 00000100:00100000:1.0:1789136165.598776:0:24894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587212416 00000100:00100000:1.0:1789136165.598780:0:24894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587212416 00000100:00100000:1.0:1789136165.598798:0:24894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789136165.598804:0:24894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a076a2e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:24125:x1876044587212416:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1789136165.598827:0:24894:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000100:00100000:3.0:1789136165.609975:0:24892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f4436a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3644:x1876044587211520:12345-0@lo:8:kworker.0 Request processed in 47012us (50259us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789136165.609987:0:24892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1789136165.610028:0:3644:0:(import.c:65:import_set_state_nolock()) ffff94a07021d000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789136165.610032:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789136165.610036:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f42b1fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876044587211520:0@lo:8:kworker.0 00000004:00080000:2.0:1789136165.614393:0:24115:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000001:00080000:3.0:1789136165.644318:0:24889:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:3.0:1789136165.644336:0:24889:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1789136165.644602:0:24894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a076a2e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:24125:x1876044587212416:12345-0@lo:5:osp-pre-0-1.0 Request processed in 45793us (45850us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1789136165.644613:0:24894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1789136165.644768:0:24125:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94a076a2c780 x1876044587212416/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789136181 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136165.644798:0:24125:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:3.0:1789136165.644804:0:24125:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a076a2c780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:24125:1876044587212416:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1789136165.644818:0:24125:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:3.0:1789136165.644867:0:24125:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f44368000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:24125:1876044587212544:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1789136165.644902:0:24125:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136165.644922:0:24125:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a0437043c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789136165.644994:0:23390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587212544 00000100:00100000:0.0:1789136165.645005:0:23390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587212544 00000100:00100000:0.0:1789136165.645049:0:23390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789136165.645066:0:23390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f44369a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:24125:x1876044587212544:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1789136165.645123:0:23390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f44369a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:24125:x1876044587212544:12345-0@lo:900:osp-pre-0-1.0 Request processed in 66us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136165.645130:0:23390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789136165.645199:0:24125:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff949f44368000 x1876044587212544/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789136181 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136165.645209:0:24125:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f44368000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:24125:1876044587212544:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1789136165.880750:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4436bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876044587212672:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789136165.880818:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136165.880872:0:24123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587212672 00000100:00100000:3.0:1789136165.880879:0:24123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587212672 00000100:00100000:3.0:1789136165.880922:0:24123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789136165.880931:0:24123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f4436ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876044587212672:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789136165.880964:0:24123:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789136165.881005:0:24123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f4436ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876044587212672:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136165.881012:0:24123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789136165.881053:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4436bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876044587212672:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789136165.882054:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a06f1a52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876044587212800:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789136165.882098:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136165.885006:0:23384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587212800 00000100:00100000:1.0:1789136165.885020:0:23384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587212800 00000100:00100000:1.0:1789136165.885374:0:23384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789136165.885389:0:23384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a06f1a4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876044587212800:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789136165.885426:0:23384:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789136165.885505:0:23384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a06f1a4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876044587212800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 120us (3405us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136165.886705:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a06f1a52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876044587212800:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789136165.890496:0:23384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:2.0:1789136166.194492:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136167.228031:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136168.247276:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789136168.625325:0:23417:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789136169.267426:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789136169.916833:0:25710:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789136169.916837:0:25710:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1789136169.916839:0:25710:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1789136169.916953:0:25710:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff94a0819e7000 00000020:01000004:3.0:1789136169.916968:0:25710:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1789136169.916983:0:25710:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789136169.917008:0:25710:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff949f43aeb490) 00000020:00000080:3.0:1789136169.917026:0:25710:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789136170.004477:0:25710:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1789136170.006981:0:25710:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1789136170.007523:0:25710:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1789136170.007813:0:25710:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1789136170.008034:0:25710:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1789136170.008412:0:25710:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1789136170.008733:0:25710:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:01000000:3.0:1789136170.011414:0:25710:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789136170.011603:0:25710:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1789136170.011616:0:25710:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789136170.011678:0:25710:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xedd53ca6b6e473a1 00000020:01000004:3.0:1789136170.011684:0:25710:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1789136170.011705:0:25710:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.156@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789136170.011708:0:25710:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.156@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789136170.011716:0:25710:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1789136170.011742:0:25710:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1789136170.011745:0:25710:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.156@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1789136170.023267:0:25710:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.156@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789136170.023309:0:25710:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.156@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1789136170.023317:0:25710:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789136170.023319:0:25710:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789136170.023320:0:25710:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789136170.023321:0:25710:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789136170.023322:0:25710:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789136170.023324:0:25710:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789136170.023325:0:25710:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789136170.023327:0:25710:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789136170.023328:0:25710:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789136170.023331:0:25710:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1789136170.023333:0:25710:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789136170.023335:0:25710:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789136170.023335:0:25710:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789136170.023336:0:25710:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789136170.023337:0:25710:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789136170.023338:0:25710:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789136170.023339:0:25710:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789136170.023340:0:25710:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789136170.023341:0:25710:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789136170.023367:0:25710:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789136170.023387:0:25710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a076a2f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:25710:1876044587212928:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789136170.023455:0:25710:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136170.023547:0:25710:0:(client.c:2715:ptlrpc_set_wait()) set ffff949f4373f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789136170.023732:0:23371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587212928 00000100:00100000:0.0:1789136170.023739:0:23371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587212928 00000100:00100000:2.0:1789136170.023899:0:23371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789136170.023910:0:23371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a049031850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+21:25710:x1876044587212928:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789136170.023940:0:23371:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1789136170.023943:0:23371:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1789136170.023947:0:23371:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1789136170.024368:0:23371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a049031850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+21:25710:x1876044587212928:12345-0@lo:253:mount.lustre.0 Request processed in 330us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136170.024377:0:23371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789136170.024455:0:25710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a076a2f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:25710:1876044587212928:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789136170.024465:0:25710:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789136170.024468:0:25710:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789136170.024469:0:25710:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789136170.024470:0:25710:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789136170.024471:0:25710:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789136170.024472:0:25710:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789136170.024473:0:25710:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789136170.024475:0:25710:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789136170.024476:0:25710:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789136170.024478:0:25710:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789136170.024498:0:25710:0:(tgt_mount.c:101:server_register_mount()) register mount ffff94a0819e7000 from lustre-OST0001 10000000:01000000:1.0:1789136170.024523:0:25710:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1789136170.024525:0:25710:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789136170.024544:0:25710:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff949f44320000 local copy 00010000:00010000:1.0:1789136170.024554:0:25710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a0429a9600/0xedd53ca6b6e470bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e470c2 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136170.024662:0:25710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a076a2f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:25710:1876044587213056:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789136170.024691:0:25710:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136170.024987:0:25710:0:(client.c:2715:ptlrpc_set_wait()) set ffff949f4373fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789136170.025054:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587213056 00000100:00100000:0.0:1789136170.025060:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587213056 00000100:00100000:0.0:1789136170.025087:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789136170.025094:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a049030850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+21:25710:x1876044587213056:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789136170.025291:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a049030850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+21:25710:x1876044587213056:12345-0@lo:501:mount.lustre.0 Request processed in 196us (597us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789136170.025299:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789136170.025440:0:25710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a076a2f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:25710:1876044587213056:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789136170.025456:0:25710:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.156@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789136170.025475:0:25710:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.156@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789136170.025481:0:25710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a0429a9600/0xedd53ca6b6e470bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e470c2 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136170.025491:0:25710:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.156@tcp lock: ffff94a0429a9600/0xedd53ca6b6e470bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e470c2 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789136170.025516:0:25710:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff94a0819e7000 10000000:01000000:1.0:1789136170.025520:0:25710:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789136170.025525:0:25710:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789136170.025528:0:25710:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789136170.025532:0:25710:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1789136170.025534:0:25710:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789136170.025555:0:25710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a07a32c000/0xedd53ca6b6e473a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136170.025563:0:25710:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.156@tcp lock: ffff94a07a32c000/0xedd53ca6b6e473a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136170.025573:0:25710:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.156@tcp lock: ffff94a07a32c000/0xedd53ca6b6e473a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136170.025595:0:25710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a076a2f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:25710:1876044587213184:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789136170.025624:0:25710:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136170.025668:0:25710:0:(client.c:2715:ptlrpc_set_wait()) set ffff949f4373fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789136170.025731:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587213184 00000100:00100000:0.0:1789136170.025736:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587213184 00000100:00100000:0.0:1789136170.025757:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789136170.025763:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a049031c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+21:25710:x1876044587213184:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789136170.025771:0:23372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136170.025782:0:23372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff949f43a19800/0xedd53ca6b6e473af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xedd53ca6b6e473a8 expref: -99 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136170.025800:0:23372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff949f43a19800/0xedd53ca6b6e473af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedd53ca6b6e473a8 expref: 22 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136170.025810:0:23372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff949f43a19800/0xedd53ca6b6e473af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedd53ca6b6e473a8 expref: 22 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136170.025825:0:23372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff949f43a19800, rc 0) 00000100:00100000:0.0:1789136170.025864:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a049031c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+22:25710:x1876044587213184:12345-0@lo:101:mount.lustre.0 Request processed in 100us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136170.025870:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789136170.025967:0:25710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a076a2f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:25710:1876044587213184:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789136170.025979:0:25710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.156@tcp lock: ffff94a07a32c000/0xedd53ca6b6e473a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e473af expref: -99 pid: 25710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136170.025988:0:25710:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.156@tcp lock: ffff94a07a32c000/0xedd53ca6b6e473a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xedd53ca6b6e473af expref: -99 pid: 25710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789136170.026937:0:25710:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:1.0:1789136170.027648:0:25710:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789136170.031786:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1789136170.031843:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:1.0:1789136170.031864:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:1.0:1789136170.031878:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:1.0:1789136170.031892:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:1.0:1789136170.031906:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:1.0:1789136170.031919:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:1.0:1789136170.031931:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:1.0:1789136170.031944:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:1.0:1789136170.031969:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:1.0:1789136170.031975:0:25710:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:1.0:1789136170.032077:0:25710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a076a2f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:25710:1876044587213312:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789136170.032139:0:25710:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136170.032346:0:23373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587213312 00000100:00100000:2.0:1789136170.032353:0:23373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587213312 00000100:00100000:1.0:1789136170.032474:0:25710:0:(client.c:2715:ptlrpc_set_wait()) set ffff949f4373f600 going to sleep for 11 seconds 00000100:00100000:2.0:1789136170.032519:0:23373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789136170.032529:0:23373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a049032450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3644072c-bb98-4fbe-9eaf-e40d57d161d0+22:25710:x1876044587213312:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789136170.032700:0:23373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a049032450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3644072c-bb98-4fbe-9eaf-e40d57d161d0+22:25710:x1876044587213312:12345-0@lo:501:mount.lustre.0 Request processed in 172us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136170.032709:0:23373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789136170.032791:0:25710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a076a2f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:25710:1876044587213312:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789136170.032839:0:25710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a076a2f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:25710:1876044587213440:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789136170.032876:0:25710:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136170.033154:0:25710:0:(client.c:2715:ptlrpc_set_wait()) set ffff949f4373f600 going to sleep for 11 seconds 00000100:00100000:3.0:1789136170.033318:0:23371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587213440 00000100:00100000:3.0:1789136170.033323:0:23371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587213440 00000100:00100000:3.0:1789136170.033350:0:23371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789136170.033357:0:23371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a049031450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+22:25710:x1876044587213440:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789136170.034547:0:23371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a049031450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+22:25710:x1876044587213440:12345-0@lo:503:mount.lustre.0 Request processed in 1187us (1666us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136170.034558:0:23371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789136170.034683:0:25710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a076a2f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:25710:1876044587213440:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789136170.035084:0:25710:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789136170.035161:0:25710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a076a2f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:25710:1876044587213568:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789136170.035219:0:25710:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136170.035258:0:25710:0:(client.c:2715:ptlrpc_set_wait()) set ffff949f4373fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789136170.035530:0:23371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587213568 00000100:00100000:3.0:1789136170.035536:0:23371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587213568 00000100:00100000:3.0:1789136170.035562:0:23371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789136170.035570:0:23371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a049030c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+22:25710:x1876044587213568:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789136170.035976:0:23371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a049030c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+22:25710:x1876044587213568:12345-0@lo:502:mount.lustre.0 Request processed in 406us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136170.035990:0:23371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789136170.036143:0:25710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a076a2f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:25710:1876044587213568:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789136170.036345:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1789136170.036373:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:1.0:1789136170.036389:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:1.0:1789136170.036405:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:1.0:1789136170.036419:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:1.0:1789136170.036434:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:1.0:1789136170.036448:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:1.0:1789136170.036463:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:1.0:1789136170.036476:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:1.0:1789136170.036499:0:25710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a076a2f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:25710:1876044587213696:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789136170.036536:0:25710:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136170.036557:0:25710:0:(client.c:2715:ptlrpc_set_wait()) set ffff949f4373fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789136170.036654:0:23371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587213696 00000100:00100000:3.0:1789136170.036659:0:23371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587213696 00000100:00100000:3.0:1789136170.036683:0:23371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789136170.036689:0:23371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a049032050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+22:25710:x1876044587213696:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789136170.036763:0:23371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a049032050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+22:25710:x1876044587213696:12345-0@lo:502:mount.lustre.0 Request processed in 73us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136170.036770:0:23371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789136170.036957:0:25710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a076a2f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:25710:1876044587213696:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789136170.036997:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:1.0:1789136170.037004:0:25710:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:1.0:1789136170.037698:0:25715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789136170.037706:0:25715:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1789136170.037719:0:25715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136170.037721:0:25715:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1789136170.037726:0:25715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789136170.037740:0:25715:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff94a043764ed8) 00000020:00000080:1.0:1789136170.037763:0:25715:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789136170.037769:0:25715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789136170.037865:0:25715:0:(tgt_mount.c:153:server_get_mount()) get mount ffff94a0819e7000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1789136170.037880:0:25715:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789136170.037886:0:25715:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xedd53ca6b6e473bd 00010000:00010000:1.0:1789136170.042445:0:25715:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:1.0:1789136170.042958:0:25715:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:1.0:1789136170.044551:0:25715:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000003:0xc:0x0] (8/32) registered 00000020:00000080:1.0:1789136170.046928:0:25715:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1789136170.046941:0:25715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789136170.046947:0:25715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136170.046949:0:25715:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1789136170.046952:0:25715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789136170.046955:0:25715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136170.046957:0:25715:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789136170.046959:0:25715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789136170.046961:0:25715:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789136170.046963:0:25715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789136170.046965:0:25715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136170.046967:0:25715:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789136170.046969:0:25715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789136170.046971:0:25715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136170.046972:0:25715:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789136170.046975:0:25715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1789136170.046993:0:25715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789136170.046995:0:25715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136170.046996:0:25715:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789136170.046999:0:25715:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:3.0:1789136170.047158:0:25710:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1789136170.047191:0:25710:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.156@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789136170.047210:0:25710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a07a32c000/0xedd53ca6b6e473a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e473af expref: -99 pid: 25710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136170.047222:0:25710:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.156@tcp lock: ffff94a07a32c000/0xedd53ca6b6e473a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e473af expref: -99 pid: 25710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789136170.047375:0:25710:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94a0819e7000 from 1 10000000:01000000:3.0:1789136170.047379:0:25710:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789136170.047411:0:25710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.156@tcp lock: ffff949f4483da00/0xedd53ca6b6e473c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136170.047419:0:25710:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.156@tcp lock: ffff949f4483da00/0xedd53ca6b6e473c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136170.047429:0:25710:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.156@tcp lock: ffff949f4483da00/0xedd53ca6b6e473c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136170.047450:0:25710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f44368f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:25710:1876044587213824:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789136170.047518:0:25710:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136170.047560:0:25710:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a043e42180 going to sleep for 11 seconds 00000100:00100000:1.0:1789136170.047616:0:23371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587213824 00000100:00100000:1.0:1789136170.047699:0:23371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587213824 00000100:00100000:1.0:1789136170.047778:0:23371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789136170.047787:0:23371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a049033450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+22:25710:x1876044587213824:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789136170.047798:0:23371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789136170.047809:0:23371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94a07a32c600/0xedd53ca6b6e473cb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xedd53ca6b6e473c4 expref: -99 pid: 23371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136170.047828:0:23371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94a07a32c600/0xedd53ca6b6e473cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedd53ca6b6e473c4 expref: 23 pid: 23371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136170.047838:0:23371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94a07a32c600/0xedd53ca6b6e473cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedd53ca6b6e473c4 expref: 23 pid: 23371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136170.047845:0:23371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94a07a32c600, rc 0) 00000100:00100000:1.0:1789136170.047887:0:23371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a049033450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+23:25710:x1876044587213824:12345-0@lo:101:mount.lustre.0 Request processed in 101us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136170.047893:0:23371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789136170.047959:0:25710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f44368f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:25710:1876044587213824:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789136170.047972:0:25710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.156@tcp lock: ffff949f4483da00/0xedd53ca6b6e473c4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e473cb expref: -99 pid: 25710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136170.047981:0:25710:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.156@tcp lock: ffff949f4483da00/0xedd53ca6b6e473c4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xedd53ca6b6e473cb expref: -99 pid: 25710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789136170.048884:0:25710:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 19 count 19 00000040:00080000:3.0:1789136170.049127:0:25710:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789136170.049332:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1789136170.049356:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:3.0:1789136170.049381:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:3.0:1789136170.049395:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:3.0:1789136170.049424:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:3.0:1789136170.049438:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:3.0:1789136170.049449:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:3.0:1789136170.049461:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 144 off9680 00000040:00080000:3.0:1789136170.049473:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9904 00000040:00080000:3.0:1789136170.049486:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10128 00000040:00080000:3.0:1789136170.049499:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 144 off10272 00000040:00080000:3.0:1789136170.049513:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10496 00000040:00080000:3.0:1789136170.049524:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 224 off10720 00000040:00080000:3.0:1789136170.049536:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 128 off10848 00000040:00080000:3.0:1789136170.049549:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off11072 00000040:00080000:3.0:1789136170.049561:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11296 00000040:00080000:3.0:1789136170.049572:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 128 off11424 00000040:00080000:3.0:1789136170.049588:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11648 00000040:00080000:3.0:1789136170.049593:0:25710:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 18 count 19 00000100:00100000:3.0:1789136170.049689:0:25710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f44368f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:25710:1876044587213952:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789136170.049755:0:25710:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136170.050125:0:25710:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a043e42e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789136170.050208:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587213952 00000100:00100000:2.0:1789136170.050214:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587213952 00000100:00100000:2.0:1789136170.050264:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789136170.050272:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a049030450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+23:25710:x1876044587213952:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789136170.050384:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a049030450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+23:25710:x1876044587213952:12345-0@lo:501:mount.lustre.0 Request processed in 113us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136170.050399:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789136170.052355:0:25710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f44368f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:25710:1876044587213952:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789136170.052410:0:25710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f44368f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:25710:1876044587214080:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789136170.052478:0:25710:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136170.052515:0:25710:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a043e42e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789136170.052830:0:23371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587214080 00000100:00100000:1.0:1789136170.052836:0:23371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587214080 00000100:00100000:1.0:1789136170.052885:0:23371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789136170.052894:0:23371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a049032850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+23:25710:x1876044587214080:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789136170.053063:0:23371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a049032850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+23:25710:x1876044587214080:12345-0@lo:503:mount.lustre.0 Request processed in 168us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136170.053071:0:23371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789136170.053162:0:25710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f44368f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:25710:1876044587214080:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789136170.056003:0:25710:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789136170.056086:0:25710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a06f1a6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:25710:1876044587214208:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789136170.056152:0:25710:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136170.056192:0:25710:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a043128240 going to sleep for 11 seconds 00000100:00100000:0.0:1789136170.056362:0:23373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587214208 00000100:00100000:0.0:1789136170.056369:0:23373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587214208 00000100:00100000:0.0:1789136170.056413:0:23373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789136170.056421:0:23373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f43751c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3644072c-bb98-4fbe-9eaf-e40d57d161d0+23:25710:x1876044587214208:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789136170.056524:0:23373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f43751c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3644072c-bb98-4fbe-9eaf-e40d57d161d0+23:25710:x1876044587214208:12345-0@lo:502:mount.lustre.0 Request processed in 102us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136170.056532:0:23373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789136170.056772:0:25710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a06f1a6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:25710:1876044587214208:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789136170.056984:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1789136170.057010:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1789136170.057023:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1789136170.057035:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1789136170.057047:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1789136170.057060:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1789136170.057072:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:2.0:1789136170.057084:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 144 off9680 00000040:00080000:2.0:1789136170.057098:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9904 00000040:00080000:2.0:1789136170.057111:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10128 00000040:00080000:2.0:1789136170.057125:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 144 off10272 00000040:00080000:2.0:1789136170.057138:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10496 00000040:00080000:2.0:1789136170.057150:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 224 off10720 00000040:00080000:2.0:1789136170.057162:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 128 off10848 00000040:00080000:2.0:1789136170.057176:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off11072 00000040:00080000:2.0:1789136170.057190:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11296 00000040:00080000:2.0:1789136170.057203:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 128 off11424 00000100:00100000:2.0:1789136170.057797:0:25710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a06f1a6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:25710:1876044587214336:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789136170.057856:0:25710:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136170.057904:0:25710:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a043128240 going to sleep for 11 seconds 00000100:00100000:1.0:1789136170.057952:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587214336 00000100:00100000:1.0:1789136170.057958:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587214336 00000100:00100000:1.0:1789136170.058002:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789136170.058011:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0769c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+23:25710:x1876044587214336:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789136170.058135:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0769c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+23:25710:x1876044587214336:12345-0@lo:502:mount.lustre.0 Request processed in 125us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136170.058143:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789136170.058336:0:25710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a06f1a6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:25710:1876044587214336:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789136170.058392:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11648 00000040:00080000:2.0:1789136170.058409:0:25710:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 18 count 19 00000020:01000000:0.0:1789136170.059159:0:25719:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789136170.059168:0:25719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789136170.059170:0:25719:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789136170.059179:0:25719:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff94a0819e7000 00000020:00000080:0.0:1789136170.059182:0:25719:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789136170.059191:0:25719:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789136170.059193:0:25719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789136170.059194:0:25719:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789136170.059196:0:25719:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789136170.059199:0:25719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789136170.059200:0:25719:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789136170.059203:0:25719:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff94a0819e7000 00000020:00000080:0.0:1789136170.059205:0:25719:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789136170.059911:0:25719:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789136170.062346:0:25719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136170.062353:0:25719:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789136170.062365:0:25719:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789136170.062372:0:25719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136170.062373:0:25719:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789136170.062379:0:25719:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff94a0819e7000 00000020:00000080:1.0:1789136170.062381:0:25719:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789136170.062442:0:25719:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789136170.062446:0:25719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136170.062448:0:25719:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789136170.062450:0:25719:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789136170.062453:0:25719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136170.062454:0:25719:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789136170.062457:0:25719:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff94a0819e7000 00000020:00000080:1.0:1789136170.062459:0:25719:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789136170.062478:0:25719:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789136170.062482:0:25719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136170.062483:0:25719:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789136170.062485:0:25719:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789136170.062488:0:25719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136170.062489:0:25719:0:(obd_config.c:1563:class_process_config()) marker 6 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789136170.062493:0:25719:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff94a0819e7000 00000020:00000080:1.0:1789136170.062495:0:25719:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789136170.062512:0:25719:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789136170.062515:0:25719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136170.062516:0:25719:0:(obd_config.c:1563:class_process_config()) marker 6 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789136170.062518:0:25719:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789136170.062520:0:25719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136170.062527:0:25719:0:(obd_config.c:1563:class_process_config()) marker 7 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789136170.062531:0:25719:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff94a0819e7000 00000020:00000080:1.0:1789136170.062534:0:25719:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789136170.062577:0:25719:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789136170.062581:0:25719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136170.062583:0:25719:0:(obd_config.c:1563:class_process_config()) marker 7 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789136170.062586:0:25719:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 19 count 19 00000020:01000000:2.0:1789136170.065737:0:25710:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-18 (rc=0) 10000000:01000000:2.0:1789136170.065790:0:25710:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789136170.065808:0:25710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.156@tcp lock: ffff949f4483da00/0xedd53ca6b6e473c4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e473cb expref: -99 pid: 25710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136170.065821:0:25710:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.156@tcp lock: ffff949f4483da00/0xedd53ca6b6e473c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e473cb expref: -99 pid: 25710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789136170.065879:0:25710:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789136170.065882:0:25710:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff94a0819e7000 10000000:01000000:2.0:1789136170.065885:0:25710:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff94a0819e7000 10000000:01000000:2.0:1789136170.065889:0:25710:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789136170.065895:0:25710:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff94a0819e7000 from 1 10000000:01000000:2.0:1789136170.065898:0:25710:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789136170.065934:0:25710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a040030600/0xedd53ca6b6e473d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136170.065942:0:25710:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.156@tcp lock: ffff94a040030600/0xedd53ca6b6e473d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136170.065954:0:25710:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.156@tcp lock: ffff94a040030600/0xedd53ca6b6e473d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136170.065977:0:25710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a06f1a6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:25710:1876044587214464:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789136170.066043:0:25710:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136170.073435:0:25710:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a043128840 going to sleep for 11 seconds 00000100:00100000:3.0:1789136170.074379:0:23371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587214464 00000100:00100000:3.0:1789136170.074388:0:23371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587214464 00000100:00100000:3.0:1789136170.074442:0:23371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789136170.074451:0:23371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0769c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+23:25710:x1876044587214464:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789136170.074468:0:23371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789136170.074486:0:23371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff949f4483dc00/0xedd53ca6b6e473d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xedd53ca6b6e473d2 expref: -99 pid: 23371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136170.074513:0:23371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff949f4483dc00/0xedd53ca6b6e473d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedd53ca6b6e473d2 expref: 24 pid: 23371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136170.074524:0:23371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff949f4483dc00/0xedd53ca6b6e473d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedd53ca6b6e473d2 expref: 24 pid: 23371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136170.074533:0:23371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff949f4483dc00, rc 0) 00000100:00100000:3.0:1789136170.074596:0:23371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0769c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+24:25710:x1876044587214464:12345-0@lo:101:mount.lustre.0 Request processed in 146us (8553us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136170.074604:0:23371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789136170.077424:0:25710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a06f1a6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:25710:1876044587214464:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789136170.077453:0:25710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.156@tcp lock: ffff94a040030600/0xedd53ca6b6e473d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e473d9 expref: -99 pid: 25710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136170.077478:0:25710:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.156@tcp lock: ffff94a040030600/0xedd53ca6b6e473d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xedd53ca6b6e473d9 expref: -99 pid: 25710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789136170.079577:0:25710:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:2.0:1789136170.079875:0:25710:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789136170.080063:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1789136170.080088:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:2.0:1789136170.080103:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:2.0:1789136170.080117:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:2.0:1789136170.080129:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:2.0:1789136170.080141:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:2.0:1789136170.080153:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:2.0:1789136170.080165:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:2.0:1789136170.080177:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1789136170.080190:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:2.0:1789136170.080202:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:2.0:1789136170.080214:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:2.0:1789136170.080227:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:2.0:1789136170.082425:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:2.0:1789136170.082448:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:2.0:1789136170.082482:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:2.0:1789136170.082500:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:2.0:1789136170.082514:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:2.0:1789136170.082526:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:2.0:1789136170.082539:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:2.0:1789136170.082553:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:2.0:1789136170.082567:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:2.0:1789136170.082581:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:2.0:1789136170.082595:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:2.0:1789136170.082610:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:2.0:1789136170.082624:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:2.0:1789136170.082676:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:2.0:1789136170.083404:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:2.0:1789136170.083432:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:2.0:1789136170.083449:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:2.0:1789136170.083464:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:2.0:1789136170.083495:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:2.0:1789136170.083512:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:2.0:1789136170.083524:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:2.0:1789136170.083538:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:2.0:1789136170.083551:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:2.0:1789136170.083565:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:2.0:1789136170.083580:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:2.0:1789136170.083594:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:2.0:1789136170.083610:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:2.0:1789136170.086345:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:2.0:1789136170.086413:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:2.0:1789136170.086431:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:2.0:1789136170.086447:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:2.0:1789136170.086461:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:2.0:1789136170.086473:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:2.0:1789136170.086488:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:2.0:1789136170.086520:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:2.0:1789136170.086703:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:2.0:1789136170.086726:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:2.0:1789136170.086747:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:2.0:1789136170.086753:0:25710:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:2.0:1789136170.086853:0:25710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a06f1a6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:25710:1876044587214592:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789136170.086916:0:25710:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136170.086958:0:25710:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a043128d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789136170.089619:0:23373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587214592 00000100:00100000:2.0:1789136170.089648:0:23373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587214592 00000100:00100000:2.0:1789136170.089701:0:23373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789136170.089719:0:23373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0769c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3644072c-bb98-4fbe-9eaf-e40d57d161d0+24:25710:x1876044587214592:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789136170.089878:0:23373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0769c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3644072c-bb98-4fbe-9eaf-e40d57d161d0+24:25710:x1876044587214592:12345-0@lo:501:mount.lustre.0 Request processed in 160us (2960us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136170.089887:0:23373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789136170.089939:0:25710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a06f1a6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:25710:1876044587214592:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789136170.089983:0:25710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a06f1a6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:25710:1876044587214720:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789136170.090055:0:25710:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136170.090094:0:25710:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a043128d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789136170.090220:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587214720 00000100:00100000:3.0:1789136170.090225:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587214720 00000100:00100000:3.0:1789136170.090327:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789136170.090334:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0769c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+24:25710:x1876044587214720:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789136170.090463:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0769c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+24:25710:x1876044587214720:12345-0@lo:503:mount.lustre.0 Request processed in 129us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136170.090470:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789136170.095424:0:25710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a06f1a6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:25710:1876044587214720:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789136170.095880:0:25710:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789136170.095963:0:25710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a06f1a6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:25710:1876044587214848:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789136170.096033:0:25710:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136170.096076:0:25710:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a043128840 going to sleep for 11 seconds 00000100:00100000:0.0:1789136170.096150:0:23373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587214848 00000100:00100000:0.0:1789136170.096157:0:23373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587214848 00000100:00100000:0.0:1789136170.098485:0:23373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789136170.098501:0:23373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0769c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3644072c-bb98-4fbe-9eaf-e40d57d161d0+24:25710:x1876044587214848:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789136170.098700:0:23373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0769c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3644072c-bb98-4fbe-9eaf-e40d57d161d0+24:25710:x1876044587214848:12345-0@lo:502:mount.lustre.0 Request processed in 203us (2666us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136170.098708:0:23373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789136170.098829:0:25710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a06f1a6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:25710:1876044587214848:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789136170.099054:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1789136170.099086:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:2.0:1789136170.099103:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:2.0:1789136170.099116:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:2.0:1789136170.099130:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:2.0:1789136170.099143:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:2.0:1789136170.099155:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:2.0:1789136170.099168:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:2.0:1789136170.099182:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1789136170.099210:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:2.0:1789136170.099226:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:2.0:1789136170.099326:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:2.0:1789136170.099352:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:2.0:1789136170.099364:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:2.0:1789136170.099376:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:2.0:1789136170.099387:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:2.0:1789136170.099397:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:2.0:1789136170.099409:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:2.0:1789136170.099420:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:2.0:1789136170.099431:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:2.0:1789136170.099443:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:2.0:1789136170.099454:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:2.0:1789136170.099465:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:2.0:1789136170.099476:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:2.0:1789136170.099487:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:2.0:1789136170.099515:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:2.0:1789136170.099531:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:2.0:1789136170.099544:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:2.0:1789136170.099557:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:2.0:1789136170.099570:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:2.0:1789136170.099583:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:2.0:1789136170.099596:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:2.0:1789136170.099607:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:2.0:1789136170.099619:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:2.0:1789136170.099683:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:2.0:1789136170.099698:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:2.0:1789136170.099709:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:2.0:1789136170.099721:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:2.0:1789136170.099732:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:2.0:1789136170.099744:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:2.0:1789136170.099758:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:2.0:1789136170.099785:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:2.0:1789136170.099800:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:2.0:1789136170.099813:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:2.0:1789136170.099825:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:2.0:1789136170.099847:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:2.0:1789136170.099860:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:2.0:1789136170.099872:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:2.0:1789136170.099917:0:25710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a06f1a6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:25710:1876044587214976:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789136170.099980:0:25710:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136170.100034:0:25710:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a043128840 going to sleep for 11 seconds 00000100:00100000:3.0:1789136170.100079:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587214976 00000100:00100000:3.0:1789136170.100087:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587214976 00000100:00100000:3.0:1789136170.100129:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789136170.100139:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0769c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+24:25710:x1876044587214976:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789136170.100258:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0769c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+24:25710:x1876044587214976:12345-0@lo:502:mount.lustre.0 Request processed in 119us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136170.100265:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789136170.102387:0:25710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a06f1a6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:25710:1876044587214976:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789136170.102607:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:2.0:1789136170.102654:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:2.0:1789136170.102689:0:25710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a06f1a6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:25710:1876044587215104:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789136170.102751:0:25710:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136170.102799:0:25710:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a043128840 going to sleep for 11 seconds 00000100:00100000:3.0:1789136170.103338:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587215104 00000100:00100000:3.0:1789136170.103346:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587215104 00000100:00100000:3.0:1789136170.103400:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789136170.103410:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0769c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+24:25710:x1876044587215104:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789136170.103517:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0769c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+24:25710:x1876044587215104:12345-0@lo:502:mount.lustre.0 Request processed in 108us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136170.103524:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789136170.103610:0:25710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a06f1a6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:25710:1876044587215104:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789136170.103692:0:25710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:2.0:1789136170.103702:0:25710:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1789136170.107932:0:25726:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789136170.107949:0:25726:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff949f42674ed8) 00000020:00000080:2.0:1789136170.107973:0:25726:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:2.0:1789136170.108065:0:25726:0:(tgt_mount.c:153:server_get_mount()) get mount ffff94a0819e7000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789136170.108069:0:25726:0:(tgt_mount.c:187:server_put_mount()) put mount ffff94a0819e7000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789136170.108071:0:25726:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94a0819e7000 3 00010000:00080000:2.0:1789136170.108099:0:25726:0:(ldlm_lib.c:102:import_set_conn()) imp ffff949f41f8f800@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.156@tcp at head 00010000:00010000:2.0:1789136170.109881:0:25726:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:2.0:1789136170.110104:0:25726:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1789136170.110144:0:25726:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789136170.110155:0:25726:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xedd53ca6b6e473e7 00000100:00080000:2.0:1789136170.110164:0:25726:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789136170.110170:0:25726:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff949f41f8f800 using connection 192.168.206.156@tcp/0@lo 00000100:00100000:2.0:1789136170.110208:0:25726:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94a06f1a6940 x1876044587215232/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789136170.115393:0:25726:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789136170.115619:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a06f1a6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1876044587215232:0@lo:38:llog_process_th.0 00000020:01000004:2.0:1789136170.115776:0:25726:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789136170.115792:0:25726:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff949f42670000) 00000020:00000080:2.0:1789136170.115815:0:25726:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:2.0:1789136170.115887:0:25726:0:(tgt_mount.c:153:server_get_mount()) get mount ffff94a0819e7000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789136170.115891:0:25726:0:(tgt_mount.c:187:server_put_mount()) put mount ffff94a0819e7000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789136170.115894:0:25726:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94a0819e7000 3 00010000:00080000:2.0:1789136170.115920:0:25726:0:(ldlm_lib.c:102:import_set_conn()) imp ffff949f41f8d000@lustre-MDT0001-lwp-OST0001: add connection 192.168.206.156@tcp at head 00000100:00100000:1.0:1789136170.116384:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789136170.116473:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789136170.116477:0:479:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789136170.116479:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789136170.116482:0:479:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789136170.116521:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789136170.116524:0:479:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789136170.116528:0:479:0:(import.c:65:import_set_state_nolock()) ffff94a07021d000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789136170.116533:0:479:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 703 00000100:00080000:1.0:1789136170.116537:0:479:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1789136170.116543:0:479:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff94a07021d000 using connection 192.168.206.156@tcp/0@lo 00000100:00100000:1.0:1789136170.116564:0:479:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94a076a2e580 x1876044587215872/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789136170.116618:0:23379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587215232 00000100:00100000:1.0:1789136170.116624:0:23379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587215232 00000100:00100000:1.0:1789136170.116668:0:23379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789136170.116675:0:23379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a076a2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1876044587215232:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789136170.116698:0:23379:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 708 last 0 00000020:00000080:1.0:1789136170.116731:0:23379:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xedd53ca6b6e473f5 00000004:00100000:1.0:1789136170.116747:0:23379:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789136170.116775:0:23379:0:(import.c:65:import_set_state_nolock()) ffff949f4509c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789136170.116819:0:23379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a076a2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876044587215232:12345-0@lo:38:llog_process_th.0 Request processed in 143us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136170.116828:0:23379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789136170.116852:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a076a2d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876044587215360:0@lo:400:kworker.0 00000100:00100000:1.0:1789136170.116881:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136170.116901:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a076a2f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876044587216000:0@lo:400:kworker.0 00000100:00100000:1.0:1789136170.116921:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136170.116939:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789136170.116945:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a076a2f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876044587215488:0@lo:400:kworker.0 00000100:00100000:1.0:1789136170.116967:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136170.116984:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a076a2da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876044587216128:0@lo:400:kworker.0 00000100:00100000:1.0:1789136170.117005:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136170.117031:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a076a2cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876044587215616:0@lo:400:kworker.0 00000100:00100000:1.0:1789136170.117054:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136170.117072:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a076a2fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876044587216256:0@lo:400:kworker.0 00000100:00100000:1.0:1789136170.117092:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136170.117103:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789136170.117108:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a076a2cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876044587215744:0@lo:400:kworker.0 00000100:00100000:1.0:1789136170.120551:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136170.120645:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a076a2e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876044587215872:0@lo:8:kworker.0 00000100:00100000:1.0:1789136170.120693:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789136170.120732:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94a06f1a6940 x1876044587215232/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789136180 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136170.120749:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789136170.120759:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:1.0:1789136170.120768:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789136170.120774:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789136170.120777:0:3644:0:(import.c:65:import_set_state_nolock()) ffff949f41f8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789136170.120783:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a06f1a6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1876044587215232:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789136170.120817:0:23380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587216000 00000100:00100000:1.0:1789136170.120823:0:23380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587216000 00000100:00100000:1.0:1789136170.120852:0:23380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587215488 00000100:00100000:1.0:1789136170.120854:0:23380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587215488 00000100:00100000:1.0:1789136170.120863:0:23380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587216128 00000100:00100000:1.0:1789136170.120865:0:23380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587216128 00000100:00100000:1.0:1789136170.120901:0:23380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587216256 00000100:00100000:1.0:1789136170.120904:0:23380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587216256 00000100:00100000:1.0:1789136170.120921:0:23380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789136170.120929:0:23380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f4416c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876044587216000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136170.120977:0:23380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f4416c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876044587216000:12345-0@lo:400:kworker.0 Request processed in 49us (4054us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136170.120983:0:23380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789136170.120997:0:23380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789136170.121002:0:23380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f4416c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876044587215488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136170.121024:0:23380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f4416c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876044587215488:12345-0@lo:400:kworker.0 Request processed in 23us (4057us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136170.121030:0:23380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789136170.121039:0:23380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789136170.121044:0:23380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f4416f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876044587216128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136170.121078:0:23380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f4416f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876044587216128:12345-0@lo:400:kworker.0 Request processed in 34us (4072us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136170.121084:0:23380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789136170.121096:0:23380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789136170.121101:0:23380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a07f6e9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876044587216256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136170.121128:0:23380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a07f6e9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876044587216256:12345-0@lo:400:kworker.0 Request processed in 28us (4036us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136170.121134:0:23380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789136170.121152:0:23383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587215360 00000100:00100000:1.0:1789136170.121155:0:23383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587215360 00000100:00100000:1.0:1789136170.121174:0:23383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587215616 00000100:00100000:1.0:1789136170.121177:0:23383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587215616 00000100:00100000:1.0:1789136170.121189:0:23383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789136170.121194:0:23383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a076a2c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876044587215360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136170.121224:0:23383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a076a2c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876044587215360:12345-0@lo:400:kworker.0 Request processed in 30us (4343us total) trans 0 rc 0/0 00010000:00010000:2.0:1789136170.122726:0:25726:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:2.0:1789136170.122919:0:25726:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1789136170.122960:0:25726:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789136170.122972:0:25726:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xedd53ca6b6e473fc 00000100:00080000:2.0:1789136170.122982:0:25726:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789136170.122987:0:25726:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff949f41f8d000 using connection 192.168.206.156@tcp/0@lo 00000100:00100000:2.0:1789136170.123017:0:25726:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94a06f1a6580 x1876044587216384/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789136170.123042:0:25726:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1789136170.123554:0:23383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789136170.123585:0:23383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789136170.123598:0:23383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f4416cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876044587215616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136170.123694:0:23383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f4416cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876044587215616:12345-0@lo:400:kworker.0 Request processed in 101us (6638us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136170.123700:0:23383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789136170.123739:0:25476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587215744 00000100:00100000:1.0:1789136170.123745:0:25476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587215744 00000100:00100000:1.0:1789136170.123782:0:25476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587215872 00000100:00100000:1.0:1789136170.123786:0:25476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587215872 00000100:00100000:1.0:1789136170.123801:0:25476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789136170.123814:0:25476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a07f6e92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876044587215744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136170.123846:0:25476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a07f6e92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876044587215744:12345-0@lo:400:kworker.0 Request processed in 33us (3302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136170.123852:0:25476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789136170.123864:0:25476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789136170.123868:0:25476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a07f6ea940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3644:x1876044587215872:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1789136170.123907:0:25476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a07f6ea940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3644:x1876044587215872:12345-0@lo:8:kworker.0 Request processed in 38us (3213us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789136170.123913:0:25476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1789136170.123932:0:23374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789136170.123936:0:23374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789136170.123938:0:23374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789136170.123968:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94a076a2f840 x1876044587215488/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136186 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136170.123982:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a076a2f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876044587215488:0@lo:400:kworker.0 00010000:00080000:1.0:1789136170.123996:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94a076a2da40 x1876044587216128/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136186 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136170.124004:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a076a2da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876044587216128:0@lo:400:kworker.0 00000100:00100000:1.0:1789136170.124016:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a076a2d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876044587215360:0@lo:400:kworker.0 00010000:00080000:1.0:1789136170.124026:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94a076a2f0c0 x1876044587216000/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136186 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136170.124034:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a076a2f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876044587216000:0@lo:400:kworker.0 00010000:00080000:1.0:1789136170.124072:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94a076a2cf00 x1876044587215744/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789136186 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136170.124095:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a076a2cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876044587215744:0@lo:400:kworker.0 00000100:00100000:1.0:1789136170.124109:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a076a2cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876044587215616:0@lo:400:kworker.0 00010000:00080000:1.0:1789136170.124119:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94a076a2fc00 x1876044587216256/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136186 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136170.124125:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a076a2fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876044587216256:0@lo:400:kworker.0 00000100:00100000:1.0:1789136170.124156:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a06f1a6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1876044587216384:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789136170.124197:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136170.127455:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789136170.127467:0:3644:0:(import.c:65:import_set_state_nolock()) ffff94a07021d000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789136170.127474:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789136170.127478:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a076a2e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876044587215872:0@lo:8:kworker.0 00000100:00080000:1.0:1789136170.127519:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789136170.127524:0:479:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789136170.127527:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789136170.127530:0:479:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789136170.127558:0:23380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587216384 00000100:00100000:1.0:1789136170.127564:0:23380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587216384 00000100:00100000:1.0:1789136170.127598:0:23380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789136170.127605:0:23380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a07f6e9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1876044587216384:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789136170.127659:0:23380:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 708 last 0 00000020:00000080:1.0:1789136170.127694:0:23380:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xedd53ca6b6e47403 00000004:00100000:1.0:1789136170.127709:0:23380:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789136170.127751:0:23380:0:(import.c:65:import_set_state_nolock()) ffff949f4509d800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789136170.127827:0:23380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a07f6e9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876044587216384:12345-0@lo:38:llog_process_th.0 Request processed in 221us (3629us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136170.127835:0:23380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1789136170.127874:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94a06f1a6580 x1876044587216384/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789136180 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136170.127884:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789136170.127890:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:1.0:1789136170.127896:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789136170.127901:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1789136170.127903:0:3644:0:(import.c:65:import_set_state_nolock()) ffff949f41f8d000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789136170.127908:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a06f1a6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1876044587216384:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1789136170.129781:0:25726:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:2.0:1789136170.129882:0:25710:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1789136170.129913:0:25710:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789136170.129932:0:25710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a040030600/0xedd53ca6b6e473d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e473d9 expref: -99 pid: 25710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136170.129943:0:25710:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.156@tcp lock: ffff94a040030600/0xedd53ca6b6e473d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e473d9 expref: -99 pid: 25710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789136170.130002:0:25710:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789136170.130004:0:25710:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789136170.130005:0:25710:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789136170.130006:0:25710:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789136170.130008:0:25710:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789136170.130009:0:25710:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789136170.130010:0:25710:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789136170.130012:0:25710:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789136170.130013:0:25710:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789136170.130017:0:25710:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1789136170.130019:0:25710:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789136170.130021:0:25710:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789136170.130022:0:25710:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789136170.130023:0:25710:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789136170.130023:0:25710:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789136170.130024:0:25710:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789136170.130025:0:25710:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789136170.130026:0:25710:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789136170.130028:0:25710:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789136170.130049:0:25710:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789136170.130066:0:25710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a06f1a6580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:25710:1876044587216512:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789136170.130122:0:25710:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136170.130153:0:25710:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a043128240 going to sleep for 11 seconds 00000100:00100000:3.0:1789136170.132975:0:23373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587216512 00000100:00100000:3.0:1789136170.132986:0:23373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587216512 00000100:00100000:3.0:1789136170.133037:0:23373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789136170.133046:0:23373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0769c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3644072c-bb98-4fbe-9eaf-e40d57d161d0+24:25710:x1876044587216512:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789136170.133075:0:23373:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1789136170.136265:0:23373:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789136170.137614:0:23373:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789136170.137768:0:23373:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1789136170.138030:0:23373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0769c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3644072c-bb98-4fbe-9eaf-e40d57d161d0+24:25710:x1876044587216512:12345-0@lo:253:mount.lustre.0 Request processed in 4981us (7903us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136170.138042:0:23373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789136170.138154:0:25710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a06f1a6580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3644072c-bb98-4fbe-9eaf-e40d57d161d0:25710:1876044587216512:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789136170.138177:0:25710:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789136170.138180:0:25710:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789136170.138182:0:25710:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789136170.138183:0:25710:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789136170.138184:0:25710:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789136170.138185:0:25710:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789136170.138186:0:25710:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789136170.138188:0:25710:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789136170.138190:0:25710:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789136170.138191:0:25710:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789136170.138207:0:25710:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1789136170.140362:0:23394:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789136170.140370:0:23394:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789136170.140393:0:23394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff94a07a32c200/0xedd53ca6b6e4740a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136170.140409:0:23394:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94a0413fd400/0xedd53ca6b6e4737e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedd53ca6b6e47377 expref: 23 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136170.140417:0:23394:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94a07a32dc00/0xedd53ca6b6e4738c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedd53ca6b6e47385 expref: 23 pid: 23371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136170.140424:0:23394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff94a07a32c200/0xedd53ca6b6e4740a lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136170.140461:0:23394:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94a07a32dc00/0xedd53ca6b6e4738c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xedd53ca6b6e47385 expref: 23 pid: 23371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136170.140490:0:23394:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94a07a32dc00/0xedd53ca6b6e4738c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xedd53ca6b6e47385 expref: 23 pid: 23371 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136170.140504:0:23394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07f6ebc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23394:1876044587216640:0@lo:104: 00000100:00100000:1.0:1789136170.140562:0:23394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789136170.140618:0:23394:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94a0413fd400/0xedd53ca6b6e4737e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xedd53ca6b6e47377 expref: 23 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136170.140650:0:23394:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94a0413fd400/0xedd53ca6b6e4737e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xedd53ca6b6e47377 expref: 23 pid: 23372 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136170.140660:0:23394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07f6ea580 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23394:1876044587216768:0@lo:104: 00000100:00100000:1.0:1789136170.140683:0:23394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136170.140699:0:23394:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a0432cfb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789136170.140729:0:23362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587216640 00000100:00100000:1.0:1789136170.140735:0:23362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587216640 00000100:00100000:1.0:1789136170.140769:0:23362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587216768 00000100:00100000:1.0:1789136170.140772:0:23362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587216768 00000100:00100000:1.0:1789136170.140785:0:23362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789136170.140793:0:23362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a07f6ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+4:23394:x1876044587216640:12345-0@lo:104: 00010000:00010000:1.0:1789136170.140805:0:23362:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.156@tcp lock: ffff94a0429a8000/0xedd53ca6b6e47385 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xedd53ca6b6e4738c expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136170.140855:0:23362:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789136170.140862:0:23362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a07f6ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+4:23394:x1876044587216640:12345-0@lo:104: Request processed in 69us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136170.140869:0:23362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789136170.140886:0:23362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789136170.140899:0:23362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a07f6e83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+3:23394:x1876044587216768:12345-0@lo:104: 00010000:00010000:1.0:1789136170.140907:0:23362:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.156@tcp lock: ffff94a07a32c800/0xedd53ca6b6e47377 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xedd53ca6b6e4737e expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136170.140939:0:23362:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789136170.140944:0:23362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a07f6e83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+3:23394:x1876044587216768:12345-0@lo:104: Request processed in 46us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136170.140950:0:23362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789136170.140980:0:23394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07f6ebc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23394:1876044587216640:0@lo:104: 00000100:00100000:1.0:1789136170.140989:0:23394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07f6ea580 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23394:1876044587216768:0@lo:104: 00010000:00010000:1.0:1789136170.141005:0:23394:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff94a07a32c200/0xedd53ca6b6e4740a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136170.141021:0:23367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789136170.141026:0:23367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.156@tcp lock: ffff94a0429a8000/0xedd53ca6b6e47385 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xedd53ca6b6e4738c expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136170.141033:0:23367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a0429a8000 already unused, calling callback (ffffffffc13c2c20) 10000000:00010000:1.0:1789136170.141037:0:23367:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.156@tcp lock: ffff94a0429a8000/0xedd53ca6b6e47385 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xedd53ca6b6e4738c expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136170.141044:0:23367:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.156@tcp lock: ffff94a0429a8000/0xedd53ca6b6e47385 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xedd53ca6b6e4738c expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789136170.141050:0:23367:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.156@tcp lock: ffff94a0429a8000/0xedd53ca6b6e47385 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xedd53ca6b6e4738c expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789136170.141055:0:23367:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789136170.141082:0:23367:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.156@tcp lock: ffff94a0429a8000/0xedd53ca6b6e47385 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedd53ca6b6e4738c expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136170.141094:0:23367:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789136170.141111:0:23367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.156@tcp lock: ffff94a0429a8000/0xedd53ca6b6e47385 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedd53ca6b6e4738c expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136170.141117:0:23367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.156@tcp lock: ffff94a0429a8000/0xedd53ca6b6e47385 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedd53ca6b6e4738c expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136170.141130:0:23367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789136170.141133:0:23367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.156@tcp lock: ffff94a07a32c800/0xedd53ca6b6e47377 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xedd53ca6b6e4737e expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136170.141139:0:23367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a07a32c800 already unused, calling callback (ffffffffc13c2c20) 10000000:00010000:1.0:1789136170.141142:0:23367:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.156@tcp lock: ffff94a07a32c800/0xedd53ca6b6e47377 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xedd53ca6b6e4737e expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136170.141149:0:23367:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.156@tcp lock: ffff94a07a32c800/0xedd53ca6b6e47377 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xedd53ca6b6e4737e expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789136170.141155:0:23367:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.156@tcp lock: ffff94a07a32c800/0xedd53ca6b6e47377 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xedd53ca6b6e4737e expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789136170.141160:0:23367:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789136170.141172:0:23367:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.156@tcp lock: ffff94a07a32c800/0xedd53ca6b6e47377 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedd53ca6b6e4737e expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136170.141178:0:23367:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789136170.141189:0:23367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.156@tcp lock: ffff94a07a32c800/0xedd53ca6b6e47377 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedd53ca6b6e4737e expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136170.141195:0:23367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.156@tcp lock: ffff94a07a32c800/0xedd53ca6b6e47377 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedd53ca6b6e4737e expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136170.141214:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136170.141215:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136170.141217:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789136170.141403:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07f6ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3644072c-bb98-4fbe-9eaf-e40d57d161d0:3646:1876044587216896:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789136170.141435:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136170.141468:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07f6ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3644072c-bb98-4fbe-9eaf-e40d57d161d0:3647:1876044587217024:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789136170.141490:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136170.141522:0:23364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587216896 00000100:00100000:1.0:1789136170.141527:0:23364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587216896 00010000:00010000:1.0:1789136170.141543:0:23364:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94a07a32dc00/0xedd53ca6b6e4738c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedd53ca6b6e47385 expref: 24 pid: 23371 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136170.141570:0:23364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587217024 00000100:00100000:1.0:1789136170.141573:0:23364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587217024 00010000:00010000:1.0:1789136170.141583:0:23364:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94a0413fd400/0xedd53ca6b6e4737e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedd53ca6b6e47377 expref: 25 pid: 23372 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136170.141594:0:23364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789136170.141600:0:23364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a07f6e8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+25:3646:x1876044587216896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789136170.141609:0:23364:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789136170.141613:0:23364:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94a07a32dc00/0xedd53ca6b6e4738c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedd53ca6b6e47385 expref: 25 pid: 23371 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136170.141622:0:23364:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94a07a32dc00/0xedd53ca6b6e4738c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xedd53ca6b6e47385 expref: 25 pid: 23371 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136170.141656:0:23364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94a07a32dc00/0xedd53ca6b6e4738c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xedd53ca6b6e47385 expref: 25 pid: 23371 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136170.141678:0:23364:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789136170.141704:0:23364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a07f6e8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+24:3646:x1876044587216896:12345-0@lo:103:ldlm_bl.0 Request processed in 104us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136170.141710:0:23364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789136170.141722:0:23364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789136170.141728:0:23364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a07f6eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+23:3647:x1876044587217024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789136170.141736:0:23364:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789136170.141740:0:23364:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94a0413fd400/0xedd53ca6b6e4737e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedd53ca6b6e47377 expref: 23 pid: 23372 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136170.141749:0:23364:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94a0413fd400/0xedd53ca6b6e4737e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xedd53ca6b6e47377 expref: 23 pid: 23372 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136170.141758:0:23364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94a0413fd400/0xedd53ca6b6e4737e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xedd53ca6b6e47377 expref: 23 pid: 23372 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136170.141770:0:23364:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff94a07a32c200/0xedd53ca6b6e4740a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136170.141777:0:23364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94a07a32c200/0xedd53ca6b6e4740a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789136170.141790:0:23364:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.013081833s 00010000:00010000:1.0:1789136170.141794:0:23364:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94a07a32c200/0xedd53ca6b6e4740a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136170.141800:0:23364:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94a07a32c200/0xedd53ca6b6e4740a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136170.141815:0:23364:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff94a07a32c200/0xedd53ca6b6e4740a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136170.141821:0:23364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff94a07a32c200/0xedd53ca6b6e4740a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136170.141826:0:23364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a07a32c200 already unused, calling callback (ffffffffc0d90550) 00010000:00010000:1.0:1789136170.141829:0:23364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff94a07a32c200/0xedd53ca6b6e4740a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136170.141835:0:23364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff94a07a32c200/0xedd53ca6b6e4740a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136170.141846:0:23364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff94a07a32c200/0xedd53ca6b6e4740a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136170.141855:0:23364:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789136170.141879:0:23364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a07f6eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+22:3647:x1876044587217024:12345-0@lo:103:ldlm_bl.0 Request processed in 152us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136170.141884:0:23364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789136170.141910:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07f6ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3644072c-bb98-4fbe-9eaf-e40d57d161d0:3646:1876044587216896:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789136170.141926:0:23394:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff94a07a32c200/0xedd53ca6b6e4740a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136170.141933:0:23394:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff94a07a32c200/0xedd53ca6b6e4740a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136170.141939:0:23394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94a07a32c200/0xedd53ca6b6e4740a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136170.141973:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07f6ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3644072c-bb98-4fbe-9eaf-e40d57d161d0:3647:1876044587217024:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789136170.143856:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1789136170.153993:0:25710:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:0.0:1789136170.157377:0:25710:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1789136170.157387:0:25710:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1789136170.157670:0:25710:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789136170.157718:0:25710:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.156@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789136170.157735:0:25710:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1789136170.157756:0:25710:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1789136170.159813:0:25710:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789136170.160763:0:25710:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789136170.290366:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789136170.992825:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07ad98b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876044587217152:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789136170.992915:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136170.995867:0:23383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587217152 00000100:00100000:1.0:1789136170.995877:0:23383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587217152 00000100:00100000:1.0:1789136170.995924:0:23383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789136170.995935:0:23383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a07f6ebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876044587217152:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789136170.995968:0:23383:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789136170.996037:0:23383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a07f6ebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876044587217152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (3122us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136170.996045:0:23383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789136170.996068:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f44368f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876044587217280:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789136170.996099:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136170.996134:0:24123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587217280 00000100:00100000:1.0:1789136170.996137:0:24123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587217280 00000100:00100000:1.0:1789136170.996156:0:24123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789136170.996161:0:24123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a07f6ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876044587217280:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789136170.996177:0:24123:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789136170.996206:0:24123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a07f6ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876044587217280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 45us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136170.996212:0:24123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789136170.996266:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f44368f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876044587217280:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789136170.996320:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07ad98b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876044587217152:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789136170.997314:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789136170.997326:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07ad992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876044587217408:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789136170.997364:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136170.997454:0:24896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587217408 00000100:00100000:0.0:1789136170.997460:0:24896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587217408 00000100:00100000:0.0:1789136170.997495:0:24896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789136170.997503:0:24896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a06f1a6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876044587217408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789136170.997523:0:24896:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3915845632 avail 3684323328 00000100:00100000:0.0:1789136170.997575:0:24896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a06f1a6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876044587217408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136170.997581:0:24896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789136170.997875:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94a07ad992c0 x1876044587217408/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789136186 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136170.998022:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07ad992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876044587217408:0@lo:13:osp-pre-0-1.0 00000020:00000004:0.0:1789136171.048158:0:25780:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789136171.048393:0:25780:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1789136171.185096:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789136151/real 1789136151] req@ffff949f4416e1c0 x1876044587203712/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789136171 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789136171.185126:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff949f4416e1c0 x1876044587203712/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789136171 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789136171.185137:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789136151/real 1789136151] req@ffff949f4416e940 x1876044587203840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789136171 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789136171.185148:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff949f4416e940 x1876044587203840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789136171 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789136171.185168:0:3644:0:(import.c:65:import_set_state_nolock()) ffff949f443e6000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789136171.185192:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789136171.185196:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4416e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876044587203712:0@lo:8:kworker.0 00000100:00080000:2.0:1789136171.185203:0:3644:0:(import.c:65:import_set_state_nolock()) ffff949f443e6800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789136171.185208:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789136171.185211:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4416e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876044587203840:0@lo:8:kworker.0 00000100:00080000:3.0:1789136171.185341:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789136171.185345:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789136171.185348:0:8:0:(import.c:65:import_set_state_nolock()) ffff949f443e6000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789136171.185353:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 689 00000100:00080000:3.0:1789136171.185357:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1789136171.185363:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff949f443e6000 using connection 192.168.206.156@tcp/0@lo 00000100:00100000:3.0:1789136171.185383:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff949f4436b840 x1876044587217664/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789136171.185395:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789136171.185397:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789136171.185399:0:8:0:(import.c:65:import_set_state_nolock()) ffff949f443e6800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789136171.185402:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 689 00000100:00080000:3.0:1789136171.185404:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1789136171.185407:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff949f443e6800 using connection 192.168.206.156@tcp/0@lo 00000100:00100000:3.0:1789136171.185417:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff949f44368780 x1876044587217792/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789136171.185435:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789136171.185447:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789136171.185449:0:8:0:(import.c:65:import_set_state_nolock()) ffff94a07021d000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789136171.185454:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff94a07021d000 using connection 192.168.206.156@tcp/0@lo 00000100:00100000:3.0:1789136171.185467:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff949f44368f00 x1876044587218048/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789136171.185552:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f44369680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876044587217920:0@lo:400:kworker.0 00000100:00100000:3.0:1789136171.185608:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136171.185663:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4402cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1876044587218560:0@lo:400:kworker.0 00000100:00100000:3.0:1789136171.185690:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136171.185710:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789136171.185716:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f443683c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3644072c-bb98-4fbe-9eaf-e40d57d161d0:3648:1876044587217536:0@lo:400:kworker.0 00000100:00100000:3.0:1789136171.185741:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136171.185763:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f44368000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1876044587218432:0@lo:400:kworker.0 00000100:00100000:3.0:1789136171.185785:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136171.185811:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4436bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876044587218176:0@lo:400:kworker.0 00000100:00100000:3.0:1789136171.185833:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136171.185850:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4402e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876044587218688:0@lo:400:kworker.0 00000100:00100000:3.0:1789136171.185870:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136171.185879:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789136171.185883:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4436b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876044587218304:0@lo:400:kworker.0 00000100:00100000:3.0:1789136171.185900:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136171.185929:0:24752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587217920 00000100:00100000:3.0:1789136171.185935:0:24752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587217920 00000100:00100000:3.0:1789136171.185964:0:24752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587218560 00000100:00100000:3.0:1789136171.185967:0:24752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587218560 00000100:00100000:3.0:1789136171.186000:0:24752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587218432 00000100:00100000:3.0:1789136171.186003:0:24752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587218432 00000100:00100000:3.0:1789136171.186013:0:24752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587218176 00000100:00100000:3.0:1789136171.186016:0:24752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587218176 00000100:00100000:3.0:1789136171.186025:0:24752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587218688 00000100:00100000:3.0:1789136171.186027:0:24752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587218688 00000100:00100000:3.0:1789136171.186039:0:24752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587218304 00000100:00100000:3.0:1789136171.186042:0:24752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587218304 00000100:00100000:3.0:1789136171.186055:0:24752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789136171.186063:0:24752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f4402ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876044587217920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136171.186112:0:24752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f4402ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876044587217920:12345-0@lo:400:kworker.0 Request processed in 48us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136171.186119:0:24752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789136171.186136:0:24752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789136171.186141:0:24752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f4402fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876044587218560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136171.186165:0:24752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f4402fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876044587218560:12345-0@lo:400:kworker.0 Request processed in 24us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136171.186170:0:24752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789136171.186181:0:24752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789136171.186187:0:24752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f4402c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876044587218432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136171.186210:0:24752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f4402c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876044587218432:12345-0@lo:400:kworker.0 Request processed in 23us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136171.186215:0:24752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789136171.186227:0:24752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789136171.186244:0:24752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f4402de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876044587218176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136171.186275:0:24752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f4402de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876044587218176:12345-0@lo:400:kworker.0 Request processed in 42us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136171.186289:0:24752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789136171.186301:0:24752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789136171.186307:0:24752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f4402cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876044587218688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136171.186336:0:24752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f4402cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876044587218688:12345-0@lo:400:kworker.0 Request processed in 29us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136171.186341:0:24752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789136171.186351:0:24752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789136171.186356:0:24752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f4402e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876044587218304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136171.186381:0:24752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f4402e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876044587218304:12345-0@lo:400:kworker.0 Request processed in 25us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136171.186386:0:24752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1789136171.186413:0:23374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789136171.186416:0:23374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789136171.186438:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff949f4436b480 x1876044587218304/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136171.186453:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4436b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876044587218304:0@lo:400:kworker.0 00010000:00080000:3.0:1789136171.186463:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff949f4436bc00 x1876044587218176/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136171.186470:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4436bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876044587218176:0@lo:400:kworker.0 00010000:00080000:3.0:1789136171.186479:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff949f4402e940 x1876044587218688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136171.186487:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4402e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876044587218688:0@lo:400:kworker.0 00010000:00080000:3.0:1789136171.186574:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff949f44368000 x1876044587218432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136171.186590:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f44368000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1876044587218432:0@lo:400:kworker.0 00010000:00080000:3.0:1789136171.186603:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff949f44369680 x1876044587217920/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136171.186611:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f44369680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876044587217920:0@lo:400:kworker.0 00010000:00080000:3.0:1789136171.186621:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff949f4402cf00 x1876044587218560/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136171.186655:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4402cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1876044587218560:0@lo:400:kworker.0 00000100:00100000:2.0:1789136171.188519:0:23371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587217536 00000100:00100000:2.0:1789136171.188530:0:23371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587217536 00000100:00100000:2.0:1789136171.188586:0:23371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789136171.188596:0:23371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0769c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+22:3648:x1876044587217536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136171.188708:0:23371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0769c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+22:3648:x1876044587217536:12345-0@lo:400:kworker.0 Request processed in 114us (2965us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136171.188716:0:23371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789136171.188755:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4436b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876044587217664:0@lo:8:kworker.0 00000100:00100000:2.0:1789136171.188790:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136171.188822:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f44368780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876044587217792:0@lo:8:kworker.0 00000100:00100000:2.0:1789136171.188856:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136171.188873:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f44368f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876044587218048:0@lo:8:kworker.0 00000100:00100000:2.0:1789136171.188900:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136171.188933:0:25476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587217664 00000100:00100000:2.0:1789136171.188937:0:25476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587217664 00000100:00100000:2.0:1789136171.188954:0:25476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587217792 00000100:00100000:2.0:1789136171.188957:0:25476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587217792 00000100:00100000:2.0:1789136171.188965:0:25476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587218048 00000100:00100000:2.0:1789136171.188967:0:25476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587218048 00000100:00100000:2.0:1789136171.188975:0:25476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789136171.188980:0:25476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a06f1a6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3644:x1876044587217664:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789136171.189004:0:25476:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 709 last 0 00000020:00000080:2.0:1789136171.189029:0:25476:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xedd53ca6b6e47411 00002000:00100000:2.0:1789136171.189042:0:25476:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff949f41f8b000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113983 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1789136171.189046:0:25476:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1789136171.189048:0:25476:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789136171.189114:0:25476:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789136171.189136:0:25476:0:(import.c:65:import_set_state_nolock()) ffff949f41f8a800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789136171.189175:0:25476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a06f1a6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3644:x1876044587217664:12345-0@lo:8:kworker.0 Request processed in 194us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136171.189182:0:25476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789136171.189194:0:25476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789136171.189198:0:25476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a06f1a5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3644:x1876044587217792:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789136171.189212:0:25476:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 709 last 0 00000020:00000080:2.0:1789136171.189227:0:25476:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xedd53ca6b6e47418 00002000:00100000:2.0:1789136171.189244:0:25476:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff949f41f89000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113983 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1789136171.189256:0:25476:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1789136171.189258:0:25476:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789136171.189383:0:25476:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789136171.189397:0:25476:0:(import.c:65:import_set_state_nolock()) ffff949f41f8d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789136171.189427:0:25476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a06f1a5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3644:x1876044587217792:12345-0@lo:8:kworker.0 Request processed in 228us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136171.189434:0:25476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789136171.189447:0:25476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789136171.189452:0:25476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a06f1a52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3644:x1876044587218048:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789136171.189466:0:25476:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 709 last 0 00000020:00000080:2.0:1789136171.189481:0:25476:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xedd53ca6b6e4741f 00002000:00100000:2.0:1789136171.189487:0:25476:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff949f41f88800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113983 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1789136171.189490:0:25476:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:2.0:1789136171.189492:0:25476:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789136171.189514:0:25476:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1789136171.189526:0:25476:0:(import.c:65:import_set_state_nolock()) ffff949f41f8b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789136171.189553:0:25476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a06f1a52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3644:x1876044587218048:12345-0@lo:8:kworker.0 Request processed in 100us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136171.189559:0:25476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1789136171.189601:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff949f4436b840 x1876044587217664/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789136196 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789136171.189611:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789136171.189618:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1789136171.189625:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789136171.189650:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1789136171.189653:0:3644:0:(import.c:65:import_set_state_nolock()) ffff949f443e6000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789136171.189673:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789136171.189678:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4436b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876044587217664:0@lo:8:kworker.0 00010000:00080000:2.0:1789136171.189692:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff949f44368780 x1876044587217792/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789136196 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789136171.189700:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789136171.189704:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1789136171.189708:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789136171.189711:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1789136171.189713:0:3644:0:(import.c:65:import_set_state_nolock()) ffff949f443e6800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789136171.189723:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789136171.189727:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f44368780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876044587217792:0@lo:8:kworker.0 00010000:00080000:2.0:1789136171.189738:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff949f44368f00 x1876044587218048/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789136196 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789136171.189747:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1789136171.189751:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789136171.189754:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1789136171.189755:0:3644:0:(import.c:65:import_set_state_nolock()) ffff94a07021d000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789136171.189765:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789136171.189768:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f44368f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876044587218048:0@lo:8:kworker.0 00000004:00080000:2.0:1789136171.189825:0:23403:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x22:0x0] 00000100:00100000:2.0:1789136171.189842:0:23403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a06f1a70c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:23403:1876044587218944:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1789136171.189867:0:23403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136171.189884:0:23403:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a0819926c0 going to sleep for 11 seconds 00000004:00080000:2.0:1789136171.189898:0:24126:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789136171.189956:0:24126:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 709284327789ns, next at 0ns, rc = 0 00080000:00080000:2.0:1789136171.189963:0:24126:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1789136171.190131:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f443683c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3644072c-bb98-4fbe-9eaf-e40d57d161d0:3648:1876044587217536:0@lo:400:kworker.0 00000100:00100000:2.0:1789136171.190157:0:25476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587218944 00000100:00100000:2.0:1789136171.190161:0:25476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587218944 00000100:00100000:2.0:1789136171.190192:0:25476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789136171.190199:0:25476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a06f1a7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:23403:x1876044587218944:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1789136171.190566:0:24127:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1789136171.190584:0:24127:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4402e940 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:24127:1876044587219200:0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1789136171.190613:0:24127:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136171.190650:0:24127:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a0622a9480 going to sleep for 11 seconds 00000100:00100000:3.0:1789136171.190663:0:24892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587219200 00000100:00100000:3.0:1789136171.190667:0:24892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587219200 00000100:00100000:3.0:1789136171.190693:0:24892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789136171.190700:0:24892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f4402d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:24127:x1876044587219200:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1789136171.190829:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a06f1a4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876044587218816:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789136171.190861:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136171.190897:0:24896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587218816 00000100:00100000:3.0:1789136171.190901:0:24896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587218816 00000100:00100000:3.0:1789136171.190927:0:24896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789136171.190933:0:24896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f4402f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1876044587218816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789136171.190944:0:24896:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3915845632 avail 3684323328 00000100:00100000:3.0:1789136171.191005:0:24896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f4402f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1876044587218816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 47us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136171.191020:0:24896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1789136171.191043:0:23374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789136171.191046:0:23374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789136171.191065:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94a06f1a4b40 x1876044587218816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789136187 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136171.191080:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a06f1a4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876044587218816:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789136171.191331:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789136171.191341:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4402cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876044587219072:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789136171.191365:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136171.191388:0:24896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587219072 00000100:00100000:3.0:1789136171.191391:0:24896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587219072 00000100:00100000:3.0:1789136171.191412:0:24896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789136171.191417:0:24896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f4402f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3648:x1876044587219072:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789136171.191427:0:24896:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1789136171.191477:0:24896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f4402f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3648:x1876044587219072:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136171.191483:0:24896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789136171.191581:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff949f4402cf00 x1876044587219072/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789136187 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136171.191595:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4402cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876044587219072:0@lo:13:osp-pre-1-1.0 00000004:00080000:0.0:1789136171.196443:0:23405:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:0.0:1789136171.196470:0:23405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07ad9ad00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:23405:1876044587219456:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789136171.198133:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789136171.198157:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07ad98780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876044587219328:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789136171.198217:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136171.199096:0:23405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136171.199126:0:23405:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a056b3cf00 going to sleep for 11 seconds 00000004:00080000:1.0:1789136171.200031:0:23402:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789136171.200118:0:23402:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 709294489802ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789136171.200125:0:23402:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1789136171.200148:0:23404:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789136171.200176:0:23404:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 709294547787ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789136171.200181:0:23404:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1789136171.200384:0:24895:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1789136171.200394:0:24895:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:2.0:1789136171.200475:0:24895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587219456 00000100:00100000:2.0:1789136171.200495:0:24895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587219456 00000004:00080000:2.0:1789136171.200591:0:24115:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:2.0:1789136171.200694:0:25792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789136171.200704:0:25792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a07ad9a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:23405:x1876044587219456:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1789136171.202456:0:24892:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1789136171.202464:0:24892:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00080000:3.0:1789136171.202565:0:23374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789136171.202724:0:24896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587219328 00000100:00100000:3.0:1789136171.202732:0:24896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587219328 00000100:00100000:3.0:1789136171.202773:0:24896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789136171.202783:0:24896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a06f1a4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1876044587219328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789136171.202812:0:24896:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1789136171.202883:0:24896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a06f1a4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1876044587219328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (4665us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136171.202891:0:24896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1789136171.202956:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94a07ad98780 x1876044587219328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789136187 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136171.202976:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07ad98780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876044587219328:0@lo:13:osp-pre-1-0.0 00002000:00080000:3.0:1789136171.203075:0:25476:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1789136171.203081:0:25476:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:3.0:1789136171.203087:0:25476:0:(ofd_dev.c:1505:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:35 to 0x280000401:65) 00000100:00100000:1.0:1789136171.203312:0:24892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f4402d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:24127:x1876044587219200:12345-0@lo:7:osp-pre-1-1.0 Request processed in 12611us (12696us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136171.203321:0:24892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00002000:00080000:1.0:1789136171.207493:0:25792:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1789136171.207504:0:25792:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -60 00002000:02000040:1.0:1789136171.207511:0:25792:0:(ofd_dev.c:1505:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:65) 00010000:00080000:3.0:1789136171.218929:0:24127:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff949f4402e940 x1876044587219200/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789136187 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136171.218948:0:24127:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4402e940 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:24127:1876044587219200:0@lo:7:osp-pre-1-1.0 00000004:00080000:3.0:1789136171.218962:0:24127:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1789136171.219000:0:24127:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4402e940 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:24127:1876044587219584:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1789136171.219050:0:24127:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136171.219078:0:24127:0:(client.c:2715:ptlrpc_set_wait()) set ffff949f42816180 going to sleep for 11 seconds 00000100:00100000:3.0:1789136171.219097:0:24895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587219584 00000100:00100000:3.0:1789136171.219101:0:24895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587219584 00000100:00100000:3.0:1789136171.219141:0:24895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789136171.219148:0:24895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f4402cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:24127:x1876044587219584:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1789136171.219170:0:24895:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:3.0:1789136171.219203:0:24895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f4402cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:24127:x1876044587219584:12345-0@lo:5:osp-pre-1-1.0 Request processed in 54us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136171.219209:0:24895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1789136171.219271:0:24127:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff949f4402e940 x1876044587219584/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789136187 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136171.219281:0:24127:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4402e940 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:24127:1876044587219584:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1789136171.219289:0:24127:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1789136171.219310:0:24127:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4402e940 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:24127:1876044587219712:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1789136171.219332:0:24127:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136171.219349:0:24127:0:(client.c:2715:ptlrpc_set_wait()) set ffff949f42816180 going to sleep for 11 seconds 00000100:00100000:3.0:1789136171.219361:0:24892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587219712 00000100:00100000:3.0:1789136171.219364:0:24892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587219712 00000100:00100000:3.0:1789136171.219387:0:24892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789136171.219393:0:24892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f4402c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:24127:x1876044587219712:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1789136171.219418:0:24892:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00000004:00080000:3.0:1789136171.222834:0:23358:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:3.0:1789136171.222857:0:23358:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:3.0:1789136171.223125:0:25476:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789136171.223134:0:25476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009076057e/0xedd53ca6b6e47426 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.223152:0:25476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=709s v=(0 0) 00010000:00010000:3.0:1789136171.223157:0:25476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789136171.223164:0:25476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009076057e/0xedd53ca6b6e47426 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.223181:0:25476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009076057e/0xedd53ca6b6e47426 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.223205:0:25476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009076057e/0xedd53ca6b6e47426 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.223212:0:25476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009076057e/0xedd53ca6b6e47426 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.223244:0:25476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789136171.223257:0:23366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789136171.223263:0:23366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009076057e/0xedd53ca6b6e47426 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.223271:0:23366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff949f4483c600 already unused, calling callback (ffffffffc0d90550) 00010000:00010000:3.0:1789136171.223275:0:23366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009076057e/0xedd53ca6b6e47426 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.223285:0:23366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009076057e/0xedd53ca6b6e47426 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.223302:0:23366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009076057e/0xedd53ca6b6e47426 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.223310:0:23366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009076057e/0xedd53ca6b6e47426 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.223328:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136171.223335:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136171.223337:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789136171.227025:0:25476:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789136171.227037:0:25476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000226fbad4/0xedd53ca6b6e4742d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.227055:0:25476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=709s v=(0 0) 00010000:00010000:3.0:1789136171.227060:0:25476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789136171.227066:0:25476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000226fbad4/0xedd53ca6b6e4742d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.227079:0:25476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000226fbad4/0xedd53ca6b6e4742d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.227087:0:25476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000226fbad4/0xedd53ca6b6e4742d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.227094:0:25476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000226fbad4/0xedd53ca6b6e4742d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.227112:0:25476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789136171.227122:0:23367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789136171.227128:0:23367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000226fbad4/0xedd53ca6b6e4742d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.227135:0:23367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff949f4483de00 already unused, calling callback (ffffffffc0d90550) 00010000:00010000:3.0:1789136171.227139:0:23367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000226fbad4/0xedd53ca6b6e4742d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.227161:0:23367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000226fbad4/0xedd53ca6b6e4742d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.227177:0:23367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000226fbad4/0xedd53ca6b6e4742d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.227183:0:23367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000226fbad4/0xedd53ca6b6e4742d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.227197:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136171.227199:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136171.227200:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789136171.237142:0:25476:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789136171.237153:0:25476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036e9fb08/0xedd53ca6b6e47434 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.237170:0:25476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=709s v=(0 0) 00010000:00010000:1.0:1789136171.237174:0:25476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789136171.237180:0:25476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036e9fb08/0xedd53ca6b6e47434 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.237195:0:25476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036e9fb08/0xedd53ca6b6e47434 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.237217:0:25476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036e9fb08/0xedd53ca6b6e47434 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.238059:0:25476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036e9fb08/0xedd53ca6b6e47434 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.238079:0:25476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789136171.238272:0:25792:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789136171.238278:0:25792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ccb17e14/0xedd53ca6b6e4743b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.238288:0:25792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=709s v=(0 0) 00010000:00010000:1.0:1789136171.238292:0:25792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789136171.238296:0:25792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ccb17e14/0xedd53ca6b6e4743b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.238309:0:25792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ccb17e14/0xedd53ca6b6e4743b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.238317:0:25792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ccb17e14/0xedd53ca6b6e4743b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.238324:0:25792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ccb17e14/0xedd53ca6b6e4743b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.238350:0:25792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789136171.238607:0:23367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789136171.238614:0:23367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036e9fb08/0xedd53ca6b6e47434 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.238623:0:23367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a07a32ce00 already unused, calling callback (ffffffffc0d90550) 00010000:00010000:3.0:1789136171.238650:0:23367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036e9fb08/0xedd53ca6b6e47434 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.238660:0:23367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036e9fb08/0xedd53ca6b6e47434 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.238677:0:23367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036e9fb08/0xedd53ca6b6e47434 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.238696:0:23367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036e9fb08/0xedd53ca6b6e47434 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.238714:0:23367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789136171.238718:0:23367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ccb17e14/0xedd53ca6b6e4743b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.238724:0:23367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a07a32cc00 already unused, calling callback (ffffffffc0d90550) 00010000:00010000:3.0:1789136171.238728:0:23367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ccb17e14/0xedd53ca6b6e4743b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.238735:0:23367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ccb17e14/0xedd53ca6b6e4743b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.238747:0:23367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ccb17e14/0xedd53ca6b6e4743b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.238754:0:23367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ccb17e14/0xedd53ca6b6e4743b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.238765:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136171.238767:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136171.238769:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136171.238775:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789136171.241468:0:25792:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789136171.241481:0:25792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055a93c06/0xedd53ca6b6e47442 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.241498:0:25792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=709s v=(0 0) 00010000:00010000:1.0:1789136171.241503:0:25792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789136171.241509:0:25792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000055a93c06/0xedd53ca6b6e47442 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.241525:0:25792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000055a93c06/0xedd53ca6b6e47442 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.241535:0:25792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055a93c06/0xedd53ca6b6e47442 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.241543:0:25792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000055a93c06/0xedd53ca6b6e47442 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.241564:0:25792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789136171.241804:0:25476:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789136171.241811:0:25476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c6863a3/0xedd53ca6b6e47449 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.241820:0:25476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=709s v=(0 0) 00010000:00010000:1.0:1789136171.241829:0:25476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789136171.241835:0:25476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c6863a3/0xedd53ca6b6e47449 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.241845:0:25476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c6863a3/0xedd53ca6b6e47449 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.241854:0:25476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c6863a3/0xedd53ca6b6e47449 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.241861:0:25476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c6863a3/0xedd53ca6b6e47449 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.241876:0:25476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789136171.242563:0:23367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789136171.242572:0:23367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000055a93c06/0xedd53ca6b6e47442 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.242588:0:23367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a07a32d000 already unused, calling callback (ffffffffc0d90550) 00010000:00010000:3.0:1789136171.242592:0:23367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000055a93c06/0xedd53ca6b6e47442 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.242601:0:23367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000055a93c06/0xedd53ca6b6e47442 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.242619:0:23367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000055a93c06/0xedd53ca6b6e47442 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.242643:0:23367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000055a93c06/0xedd53ca6b6e47442 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.242660:0:23367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789136171.242664:0:23367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c6863a3/0xedd53ca6b6e47449 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.242670:0:23367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a07a32d400 already unused, calling callback (ffffffffc0d90550) 00010000:00010000:3.0:1789136171.242673:0:23367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c6863a3/0xedd53ca6b6e47449 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.242680:0:23367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c6863a3/0xedd53ca6b6e47449 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.242690:0:23367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c6863a3/0xedd53ca6b6e47449 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.242703:0:23367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c6863a3/0xedd53ca6b6e47449 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.242717:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136171.242719:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136171.242720:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136171.242727:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789136171.253854:0:25476:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789136171.253866:0:25476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095852bdd/0xedd53ca6b6e47450 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.253883:0:25476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=709s v=(0 0) 00010000:00010000:1.0:1789136171.253887:0:25476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789136171.254377:0:25476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095852bdd/0xedd53ca6b6e47450 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.254398:0:25476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095852bdd/0xedd53ca6b6e47450 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.254409:0:25476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095852bdd/0xedd53ca6b6e47450 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.254423:0:25476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095852bdd/0xedd53ca6b6e47450 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.254447:0:25476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789136171.254673:0:25792:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789136171.254679:0:25792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bbdf23dc/0xedd53ca6b6e47457 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.254688:0:25792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=709s v=(0 0) 00010000:00010000:1.0:1789136171.254691:0:25792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789136171.254695:0:25792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bbdf23dc/0xedd53ca6b6e47457 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.254705:0:25792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bbdf23dc/0xedd53ca6b6e47457 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.254713:0:25792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bbdf23dc/0xedd53ca6b6e47457 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.254720:0:25792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bbdf23dc/0xedd53ca6b6e47457 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.254734:0:25792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789136171.257354:0:23367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789136171.257366:0:23367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095852bdd/0xedd53ca6b6e47450 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.257379:0:23367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a07a32c200 already unused, calling callback (ffffffffc0d90550) 00010000:00010000:3.0:1789136171.257384:0:23367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095852bdd/0xedd53ca6b6e47450 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.257395:0:23367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095852bdd/0xedd53ca6b6e47450 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.257416:0:23367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095852bdd/0xedd53ca6b6e47450 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.257424:0:23367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095852bdd/0xedd53ca6b6e47450 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.257443:0:23367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789136171.257448:0:23367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bbdf23dc/0xedd53ca6b6e47457 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.257463:0:23367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a07a32dc00 already unused, calling callback (ffffffffc0d90550) 00010000:00010000:3.0:1789136171.257466:0:23367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bbdf23dc/0xedd53ca6b6e47457 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.257475:0:23367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bbdf23dc/0xedd53ca6b6e47457 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.257486:0:23367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bbdf23dc/0xedd53ca6b6e47457 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.257492:0:23367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bbdf23dc/0xedd53ca6b6e47457 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.257505:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136171.257507:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136171.257508:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136171.257515:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789136171.258374:0:25476:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789136171.258383:0:25476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001917aa93/0xedd53ca6b6e4745e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.258405:0:25476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=709s v=(0 0) 00010000:00010000:1.0:1789136171.258409:0:25476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789136171.258414:0:25476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001917aa93/0xedd53ca6b6e4745e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.258431:0:25476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001917aa93/0xedd53ca6b6e4745e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.258439:0:25476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001917aa93/0xedd53ca6b6e4745e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.258446:0:25476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001917aa93/0xedd53ca6b6e4745e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.258471:0:25476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789136171.258739:0:25792:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789136171.258745:0:25792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002bb2f7e5/0xedd53ca6b6e47465 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.258757:0:25792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=709s v=(0 0) 00010000:00010000:1.0:1789136171.258760:0:25792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789136171.258764:0:25792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002bb2f7e5/0xedd53ca6b6e47465 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.258773:0:25792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002bb2f7e5/0xedd53ca6b6e47465 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.258796:0:25792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002bb2f7e5/0xedd53ca6b6e47465 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.258803:0:25792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002bb2f7e5/0xedd53ca6b6e47465 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.258815:0:25792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789136171.260946:0:23367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789136171.260956:0:23367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001917aa93/0xedd53ca6b6e4745e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.260968:0:23367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a07a32c800 already unused, calling callback (ffffffffc0d90550) 00010000:00010000:3.0:1789136171.260972:0:23367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001917aa93/0xedd53ca6b6e4745e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.260994:0:23367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001917aa93/0xedd53ca6b6e4745e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.261012:0:23367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001917aa93/0xedd53ca6b6e4745e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.261020:0:23367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001917aa93/0xedd53ca6b6e4745e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.261039:0:23367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789136171.261043:0:23367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002bb2f7e5/0xedd53ca6b6e47465 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.261049:0:23367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a0429a8000 already unused, calling callback (ffffffffc0d90550) 00010000:00010000:3.0:1789136171.261052:0:23367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002bb2f7e5/0xedd53ca6b6e47465 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.261060:0:23367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002bb2f7e5/0xedd53ca6b6e47465 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.261071:0:23367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002bb2f7e5/0xedd53ca6b6e47465 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.261077:0:23367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002bb2f7e5/0xedd53ca6b6e47465 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.261104:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136171.261105:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136171.261107:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136171.261114:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789136171.261173:0:25476:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789136171.261181:0:25476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ec1e7fb/0xedd53ca6b6e4746c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.261192:0:25476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=709s v=(0 0) 00010000:00010000:1.0:1789136171.261196:0:25476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789136171.261203:0:25476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ec1e7fb/0xedd53ca6b6e4746c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.261214:0:25476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ec1e7fb/0xedd53ca6b6e4746c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.261223:0:25476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ec1e7fb/0xedd53ca6b6e4746c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.261240:0:25476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005ec1e7fb/0xedd53ca6b6e4746c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.261270:0:25476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789136171.261948:0:23367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789136171.261955:0:23367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005ec1e7fb/0xedd53ca6b6e4746c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.261963:0:23367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a060036200 already unused, calling callback (ffffffffc0d90550) 00010000:00010000:3.0:1789136171.261967:0:23367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005ec1e7fb/0xedd53ca6b6e4746c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.261975:0:23367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005ec1e7fb/0xedd53ca6b6e4746c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.261989:0:23367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005ec1e7fb/0xedd53ca6b6e4746c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.261997:0:23367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ec1e7fb/0xedd53ca6b6e4746c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.262011:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136171.262013:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136171.262014:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789136171.262182:0:25792:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789136171.262189:0:25792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008425556f/0xedd53ca6b6e47473 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.262197:0:25792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=709s v=(0 0) 00010000:00010000:1.0:1789136171.262200:0:25792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789136171.262205:0:25792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008425556f/0xedd53ca6b6e47473 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.262214:0:25792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008425556f/0xedd53ca6b6e47473 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.262222:0:25792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008425556f/0xedd53ca6b6e47473 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.262229:0:25792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008425556f/0xedd53ca6b6e47473 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.262258:0:25792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789136171.262594:0:25476:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789136171.262601:0:25476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b824427d/0xedd53ca6b6e4747a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.262609:0:25476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=709s v=(0 0) 00010000:00010000:1.0:1789136171.262619:0:25476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789136171.262624:0:25476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b824427d/0xedd53ca6b6e4747a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.262651:0:25476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b824427d/0xedd53ca6b6e4747a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.262660:0:25476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b824427d/0xedd53ca6b6e4747a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.262667:0:25476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b824427d/0xedd53ca6b6e4747a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.262681:0:25476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1789136171.262822:0:25792:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789136171.262828:0:25792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061d8f48c/0xedd53ca6b6e47481 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.262837:0:25792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=709s v=(0 0) 00010000:00010000:1.0:1789136171.262840:0:25792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789136171.262844:0:25792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061d8f48c/0xedd53ca6b6e47481 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.262853:0:25792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000061d8f48c/0xedd53ca6b6e47481 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.262862:0:25792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061d8f48c/0xedd53ca6b6e47481 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.262874:0:25792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000061d8f48c/0xedd53ca6b6e47481 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.262882:0:25792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1789136171.263838:0:23366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789136171.263847:0:23366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008425556f/0xedd53ca6b6e47473 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.263863:0:23366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a060037c00 already unused, calling callback (ffffffffc0d90550) 00010000:00010000:3.0:1789136171.263868:0:23366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008425556f/0xedd53ca6b6e47473 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.263877:0:23366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008425556f/0xedd53ca6b6e47473 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.263894:0:23366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008425556f/0xedd53ca6b6e47473 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.263902:0:23366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008425556f/0xedd53ca6b6e47473 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.263923:0:23366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789136171.263927:0:23366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b824427d/0xedd53ca6b6e4747a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.263933:0:23366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a060037400 already unused, calling callback (ffffffffc0d90550) 00010000:00010000:3.0:1789136171.263936:0:23366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b824427d/0xedd53ca6b6e4747a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.263944:0:23366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b824427d/0xedd53ca6b6e4747a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.263954:0:23366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b824427d/0xedd53ca6b6e4747a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.263967:0:23366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b824427d/0xedd53ca6b6e4747a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.263981:0:23366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789136171.263984:0:23366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000061d8f48c/0xedd53ca6b6e47481 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.263991:0:23366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a060036600 already unused, calling callback (ffffffffc0d90550) 00010000:00010000:3.0:1789136171.263993:0:23366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000061d8f48c/0xedd53ca6b6e47481 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.264001:0:23366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000061d8f48c/0xedd53ca6b6e47481 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.264010:0:23366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000061d8f48c/0xedd53ca6b6e47481 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.264017:0:23366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000061d8f48c/0xedd53ca6b6e47481 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.264027:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136171.264029:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136171.264031:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136171.264037:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789136171.265243:0:25476:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789136171.265253:0:25476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d038b97d/0xedd53ca6b6e47488 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.265267:0:25476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=709s v=(0 0) 00010000:00010000:1.0:1789136171.265272:0:25476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789136171.265277:0:25476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d038b97d/0xedd53ca6b6e47488 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.265289:0:25476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d038b97d/0xedd53ca6b6e47488 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.265299:0:25476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d038b97d/0xedd53ca6b6e47488 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.265306:0:25476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d038b97d/0xedd53ca6b6e47488 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.266130:0:25476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789136171.266288:0:25792:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789136171.266295:0:25792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000807f57b7/0xedd53ca6b6e4748f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.266322:0:25792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=709s v=(0 0) 00010000:00010000:1.0:1789136171.266326:0:25792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789136171.266331:0:25792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000807f57b7/0xedd53ca6b6e4748f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.266344:0:25792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000807f57b7/0xedd53ca6b6e4748f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.266352:0:25792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000807f57b7/0xedd53ca6b6e4748f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.266377:0:25792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000807f57b7/0xedd53ca6b6e4748f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.266391:0:25792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1789136171.266494:0:25476:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789136171.266500:0:25476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4651140/0xedd53ca6b6e47496 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.266508:0:25476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=709s v=(0 0) 00010000:00010000:1.0:1789136171.266511:0:25476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789136171.266515:0:25476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4651140/0xedd53ca6b6e47496 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.266524:0:25476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4651140/0xedd53ca6b6e47496 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.266543:0:25476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4651140/0xedd53ca6b6e47496 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.266551:0:25476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4651140/0xedd53ca6b6e47496 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.266560:0:25476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1789136171.266699:0:25792:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789136171.266705:0:25792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e18cfdae/0xedd53ca6b6e4749d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.266713:0:25792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=709s v=(0 0) 00010000:00010000:1.0:1789136171.266716:0:25792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789136171.266720:0:25792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e18cfdae/0xedd53ca6b6e4749d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.266729:0:25792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e18cfdae/0xedd53ca6b6e4749d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.266737:0:25792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e18cfdae/0xedd53ca6b6e4749d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.266746:0:25792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e18cfdae/0xedd53ca6b6e4749d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.266780:0:25792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1789136171.266839:0:23366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1789136171.266846:0:23366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d038b97d/0xedd53ca6b6e47488 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.266862:0:23366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a060037a00 already unused, calling callback (ffffffffc0d90550) 00010000:00010000:3.0:1789136171.266866:0:23366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d038b97d/0xedd53ca6b6e47488 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.266875:0:23366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d038b97d/0xedd53ca6b6e47488 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789136171.266886:0:25476:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789136171.266890:0:23366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d038b97d/0xedd53ca6b6e47488 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.266898:0:23366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d038b97d/0xedd53ca6b6e47488 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.266902:0:25476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009390c520/0xedd53ca6b6e474a4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.266909:0:25476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=709s v=(0 0) 00010000:00010000:1.0:1789136171.266912:0:25476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789136171.266914:0:23366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789136171.266916:0:25476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009390c520/0xedd53ca6b6e474a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.266918:0:23366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000807f57b7/0xedd53ca6b6e4748f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.266925:0:23366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a060037e00 already unused, calling callback (ffffffffc0d90550) 00010000:00010000:1.0:1789136171.266925:0:25476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009390c520/0xedd53ca6b6e474a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.266928:0:23366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000807f57b7/0xedd53ca6b6e4748f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.266934:0:25476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009390c520/0xedd53ca6b6e474a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.266936:0:23366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000807f57b7/0xedd53ca6b6e4748f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.266942:0:25476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009390c520/0xedd53ca6b6e474a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.266946:0:23366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000807f57b7/0xedd53ca6b6e4748f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.266949:0:25476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1789136171.266958:0:23366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000807f57b7/0xedd53ca6b6e4748f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.266970:0:23366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789136171.266973:0:23366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4651140/0xedd53ca6b6e47496 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.266980:0:23366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a060036e00 already unused, calling callback (ffffffffc0d90550) 00010000:00010000:3.0:1789136171.266983:0:23366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4651140/0xedd53ca6b6e47496 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.266991:0:23366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4651140/0xedd53ca6b6e47496 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.267000:0:23366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4651140/0xedd53ca6b6e47496 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.267007:0:23366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4651140/0xedd53ca6b6e47496 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.267019:0:23366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789136171.267022:0:23366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e18cfdae/0xedd53ca6b6e4749d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.267028:0:23366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a060037000 already unused, calling callback (ffffffffc0d90550) 00010000:00010000:3.0:1789136171.267036:0:23366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e18cfdae/0xedd53ca6b6e4749d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.267044:0:23366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e18cfdae/0xedd53ca6b6e4749d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.267054:0:23366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e18cfdae/0xedd53ca6b6e4749d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.267061:0:23366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e18cfdae/0xedd53ca6b6e4749d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.267074:0:23366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789136171.267077:0:23366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009390c520/0xedd53ca6b6e474a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.267083:0:23366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a060036c00 already unused, calling callback (ffffffffc0d90550) 00010000:00010000:3.0:1789136171.267086:0:23366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009390c520/0xedd53ca6b6e474a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.267094:0:23366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009390c520/0xedd53ca6b6e474a4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.267104:0:23366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009390c520/0xedd53ca6b6e474a4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.267110:0:23366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009390c520/0xedd53ca6b6e474a4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.267130:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136171.267132:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136171.267133:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136171.267139:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789136171.271028:0:25476:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789136171.271039:0:25476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed2696f7/0xedd53ca6b6e474ab lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.271057:0:25476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=709s v=(0 0) 00010000:00010000:1.0:1789136171.271068:0:25476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789136171.271073:0:25476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed2696f7/0xedd53ca6b6e474ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.271087:0:25476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed2696f7/0xedd53ca6b6e474ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.271096:0:25476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed2696f7/0xedd53ca6b6e474ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.271103:0:25476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed2696f7/0xedd53ca6b6e474ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.271119:0:25476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789136171.271252:0:23366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789136171.271258:0:23366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed2696f7/0xedd53ca6b6e474ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.271266:0:23366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a060036400 already unused, calling callback (ffffffffc0d90550) 00010000:00010000:1.0:1789136171.271270:0:23366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed2696f7/0xedd53ca6b6e474ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.271278:0:23366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed2696f7/0xedd53ca6b6e474ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.271294:0:23366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed2696f7/0xedd53ca6b6e474ab lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.271313:0:23366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed2696f7/0xedd53ca6b6e474ab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.271329:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136171.271331:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136171.271332:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789136171.272148:0:25476:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789136171.272157:0:25476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eeaa7cf4/0xedd53ca6b6e474b2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.272168:0:25476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=709s v=(0 0) 00010000:00010000:1.0:1789136171.272171:0:25476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789136171.272176:0:25476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eeaa7cf4/0xedd53ca6b6e474b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.272187:0:25476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eeaa7cf4/0xedd53ca6b6e474b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.272195:0:25476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eeaa7cf4/0xedd53ca6b6e474b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.272203:0:25476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eeaa7cf4/0xedd53ca6b6e474b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.272218:0:25476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789136171.272503:0:23367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789136171.272513:0:23367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eeaa7cf4/0xedd53ca6b6e474b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.272521:0:23367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a060037200 already unused, calling callback (ffffffffc0d90550) 00010000:00010000:1.0:1789136171.272525:0:23367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eeaa7cf4/0xedd53ca6b6e474b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.272533:0:23367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eeaa7cf4/0xedd53ca6b6e474b2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.272547:0:23367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eeaa7cf4/0xedd53ca6b6e474b2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.272554:0:23367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eeaa7cf4/0xedd53ca6b6e474b2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.272567:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136171.272569:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136171.272570:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789136171.275671:0:25476:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789136171.275685:0:25476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bb21a4a/0xedd53ca6b6e474b9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.275703:0:25476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=709s v=(0 0) 00010000:00010000:1.0:1789136171.275707:0:25476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789136171.275714:0:25476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001bb21a4a/0xedd53ca6b6e474b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.275741:0:25476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001bb21a4a/0xedd53ca6b6e474b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.275766:0:25476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bb21a4a/0xedd53ca6b6e474b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.275774:0:25476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001bb21a4a/0xedd53ca6b6e474b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.275812:0:25476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789136171.276098:0:23366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789136171.276104:0:23366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001bb21a4a/0xedd53ca6b6e474b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.276112:0:23366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a060037800 already unused, calling callback (ffffffffc0d90550) 00010000:00010000:1.0:1789136171.276116:0:23366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001bb21a4a/0xedd53ca6b6e474b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.276124:0:23366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001bb21a4a/0xedd53ca6b6e474b9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.276140:0:23366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001bb21a4a/0xedd53ca6b6e474b9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.276147:0:23366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001bb21a4a/0xedd53ca6b6e474b9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.276169:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136171.276171:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136171.276172:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789136171.276984:0:25711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:1.0:1789136171.277007:0:25711:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1789136171.277012:0:25711:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1789136171.277138:0:24892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f4402c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:24127:x1876044587219712:12345-0@lo:5:osp-pre-1-1.0 Request processed in 57742us (57802us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1789136171.277148:0:24892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00002000:00010000:0.0:1789136171.277672:0:25792:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789136171.277681:0:25792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1eff945/0xedd53ca6b6e474c0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.277699:0:25792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=709s v=(0 0) 00010000:00010000:0.0:1789136171.277704:0:25792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136171.277710:0:25792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1eff945/0xedd53ca6b6e474c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.277723:0:25792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1eff945/0xedd53ca6b6e474c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.277732:0:25792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1eff945/0xedd53ca6b6e474c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.277740:0:25792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1eff945/0xedd53ca6b6e474c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.277762:0:25792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789136171.277977:0:23367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789136171.277984:0:23367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1eff945/0xedd53ca6b6e474c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.277992:0:23367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff949f43a18800 already unused, calling callback (ffffffffc0d90550) 00010000:00010000:1.0:1789136171.277995:0:23367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1eff945/0xedd53ca6b6e474c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.278003:0:23367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1eff945/0xedd53ca6b6e474c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.278018:0:23367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1eff945/0xedd53ca6b6e474c0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.278025:0:23367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1eff945/0xedd53ca6b6e474c0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.278049:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136171.278051:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136171.278052:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789136171.280064:0:25476:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789136171.280078:0:25476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad5aadb4/0xedd53ca6b6e474c7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.280094:0:25476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=709s v=(0 0) 00010000:00010000:1.0:1789136171.280098:0:25476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789136171.280104:0:25476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad5aadb4/0xedd53ca6b6e474c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.280118:0:25476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad5aadb4/0xedd53ca6b6e474c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.280128:0:25476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad5aadb4/0xedd53ca6b6e474c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.280135:0:25476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad5aadb4/0xedd53ca6b6e474c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.280153:0:25476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789136171.280363:0:23366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789136171.280370:0:23366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad5aadb4/0xedd53ca6b6e474c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.280388:0:23366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a060036000 already unused, calling callback (ffffffffc0d90550) 00010000:00010000:1.0:1789136171.280392:0:23366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad5aadb4/0xedd53ca6b6e474c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.280400:0:23366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad5aadb4/0xedd53ca6b6e474c7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.280415:0:23366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad5aadb4/0xedd53ca6b6e474c7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.280421:0:23366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad5aadb4/0xedd53ca6b6e474c7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.280439:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136171.280441:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136171.280442:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789136171.281041:0:25792:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789136171.281048:0:25792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037fa2c34/0xedd53ca6b6e474ce lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.281058:0:25792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=709s v=(0 0) 00010000:00010000:1.0:1789136171.281061:0:25792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789136171.281066:0:25792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037fa2c34/0xedd53ca6b6e474ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.281075:0:25792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000037fa2c34/0xedd53ca6b6e474ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.281090:0:25792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037fa2c34/0xedd53ca6b6e474ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.281097:0:25792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000037fa2c34/0xedd53ca6b6e474ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.281109:0:25792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789136171.281227:0:23367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789136171.281242:0:23367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000037fa2c34/0xedd53ca6b6e474ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.281249:0:23367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a060037600 already unused, calling callback (ffffffffc0d90550) 00010000:00010000:1.0:1789136171.281253:0:23367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000037fa2c34/0xedd53ca6b6e474ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.281261:0:23367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000037fa2c34/0xedd53ca6b6e474ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.281273:0:23367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000037fa2c34/0xedd53ca6b6e474ce lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.281280:0:23367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037fa2c34/0xedd53ca6b6e474ce lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.281294:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136171.281301:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136171.281303:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789136171.281354:0:25476:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789136171.281360:0:25476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098c1e007/0xedd53ca6b6e474d5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.281368:0:25476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=709s v=(0 0) 00010000:00010000:1.0:1789136171.281371:0:25476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789136171.281376:0:25476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098c1e007/0xedd53ca6b6e474d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.281385:0:25476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000098c1e007/0xedd53ca6b6e474d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.281393:0:25476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098c1e007/0xedd53ca6b6e474d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.281399:0:25476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000098c1e007/0xedd53ca6b6e474d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.281412:0:25476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789136171.281493:0:23366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789136171.281498:0:23366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000098c1e007/0xedd53ca6b6e474d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136171.281501:0:24127:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00010000:00010000:1.0:1789136171.281505:0:23366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a060036800 already unused, calling callback (ffffffffc0d90550) 00010000:00010000:1.0:1789136171.281508:0:23366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000098c1e007/0xedd53ca6b6e474d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136171.281511:0:24127:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4402e940 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:24127:1876044587219712:0@lo:5:osp-pre-1-1.0 00010000:00010000:1.0:1789136171.281524:0:23366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000098c1e007/0xedd53ca6b6e474d5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789136171.281526:0:24127:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00010000:00010000:1.0:1789136171.281535:0:23366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000098c1e007/0xedd53ca6b6e474d5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.281541:0:23366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098c1e007/0xedd53ca6b6e474d5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.281552:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136171.281554:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136171.281555:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136171.281571:0:24127:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4402e940 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:24127:1876044587219840:0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1789136171.281624:0:24127:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136171.281675:0:24127:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a050ae7c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789136171.282606:0:23390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587219840 00000100:00100000:1.0:1789136171.282614:0:23390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587219840 00000100:00100000:1.0:1789136171.282679:0:23390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789136171.282689:0:23390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f4402e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:24127:x1876044587219840:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1789136171.283852:0:23390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f4402e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:24127:x1876044587219840:12345-0@lo:900:osp-pre-1-1.0 Request processed in 1159us (2221us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136171.283862:0:23390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00002000:00010000:1.0:1789136171.284006:0:25476:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789136171.284014:0:25476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007278c9a9/0xedd53ca6b6e474dc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.284027:0:25476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=709s v=(0 0) 00010000:00010000:1.0:1789136171.284031:0:25476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789136171.284045:0:25476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007278c9a9/0xedd53ca6b6e474dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.284058:0:25476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007278c9a9/0xedd53ca6b6e474dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.284068:0:25476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007278c9a9/0xedd53ca6b6e474dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.284075:0:25476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007278c9a9/0xedd53ca6b6e474dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1789136171.284078:0:24127:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff949f4402e940 x1876044587219840/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789136187 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1789136171.284090:0:25476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789136171.284092:0:24127:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4402e940 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:24127:1876044587219840:0@lo:900:osp-pre-1-1.0 00010000:00010000:1.0:1789136171.284257:0:23367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789136171.284263:0:23367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007278c9a9/0xedd53ca6b6e474dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.284271:0:23367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a060036a00 already unused, calling callback (ffffffffc0d90550) 00010000:00010000:1.0:1789136171.284275:0:23367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007278c9a9/0xedd53ca6b6e474dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.284283:0:23367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007278c9a9/0xedd53ca6b6e474dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.284298:0:23367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007278c9a9/0xedd53ca6b6e474dc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.284368:0:23367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007278c9a9/0xedd53ca6b6e474dc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.284410:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136171.284412:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136171.284414:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789136171.284500:0:25476:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789136171.284506:0:25476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000226fbad4/0xedd53ca6b6e474e3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.284514:0:25476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=709s v=(0 0) 00010000:00010000:3.0:1789136171.284518:0:25476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789136171.284522:0:25476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000226fbad4/0xedd53ca6b6e474e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.284531:0:25476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000226fbad4/0xedd53ca6b6e474e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.284550:0:25476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000226fbad4/0xedd53ca6b6e474e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.284557:0:25476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000226fbad4/0xedd53ca6b6e474e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.284574:0:25476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789136171.284616:0:23366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789136171.284621:0:23366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000226fbad4/0xedd53ca6b6e474e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.284648:0:23366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff949f4483de00 already unused, calling callback (ffffffffc0d90550) 00010000:00010000:1.0:1789136171.284652:0:23366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000226fbad4/0xedd53ca6b6e474e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.284660:0:23366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000226fbad4/0xedd53ca6b6e474e3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.284671:0:23366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000226fbad4/0xedd53ca6b6e474e3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.284678:0:23366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000226fbad4/0xedd53ca6b6e474e3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.284691:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136171.284693:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136171.284694:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789136171.284896:0:25476:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789136171.284902:0:25476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009076057e/0xedd53ca6b6e474ea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.284910:0:25476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=709s v=(0 0) 00010000:00010000:3.0:1789136171.284913:0:25476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789136171.284917:0:25476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009076057e/0xedd53ca6b6e474ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.284926:0:25476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009076057e/0xedd53ca6b6e474ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.284934:0:25476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009076057e/0xedd53ca6b6e474ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.284941:0:25476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009076057e/0xedd53ca6b6e474ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.284971:0:25476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789136171.285045:0:23367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789136171.285051:0:23367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009076057e/0xedd53ca6b6e474ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.285058:0:23367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff949f4483c600 already unused, calling callback (ffffffffc0d90550) 00010000:00010000:1.0:1789136171.285062:0:23367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009076057e/0xedd53ca6b6e474ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.285070:0:23367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009076057e/0xedd53ca6b6e474ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.285081:0:23367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009076057e/0xedd53ca6b6e474ea lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.285088:0:23367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009076057e/0xedd53ca6b6e474ea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.285101:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136171.285103:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136171.285105:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789136171.285265:0:25476:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789136171.285270:0:25476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d2b3a3a/0xedd53ca6b6e474f1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.285278:0:25476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=709s v=(0 0) 00010000:00010000:3.0:1789136171.285281:0:25476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789136171.285284:0:25476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d2b3a3a/0xedd53ca6b6e474f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.285293:0:25476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d2b3a3a/0xedd53ca6b6e474f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.285300:0:25476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d2b3a3a/0xedd53ca6b6e474f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.285306:0:25476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d2b3a3a/0xedd53ca6b6e474f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.285324:0:25476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789136171.285342:0:23366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789136171.285346:0:23366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d2b3a3a/0xedd53ca6b6e474f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.285354:0:23366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff949f4483ca00 already unused, calling callback (ffffffffc0d90550) 00010000:00010000:1.0:1789136171.285357:0:23366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d2b3a3a/0xedd53ca6b6e474f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.285375:0:23366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d2b3a3a/0xedd53ca6b6e474f1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.285387:0:23366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d2b3a3a/0xedd53ca6b6e474f1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.285394:0:23366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d2b3a3a/0xedd53ca6b6e474f1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.285406:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136171.285408:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136171.285410:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789136171.285714:0:25476:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789136171.285721:0:25476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000250e6c47/0xedd53ca6b6e474f8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.285729:0:25476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=709s v=(0 0) 00010000:00010000:3.0:1789136171.285738:0:25476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789136171.285742:0:25476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000250e6c47/0xedd53ca6b6e474f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.285751:0:25476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000250e6c47/0xedd53ca6b6e474f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.285759:0:25476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000250e6c47/0xedd53ca6b6e474f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.285765:0:25476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000250e6c47/0xedd53ca6b6e474f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.285783:0:25476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789136171.285964:0:23367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789136171.285969:0:23367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000250e6c47/0xedd53ca6b6e474f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.285977:0:23367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff949f4483d600 already unused, calling callback (ffffffffc0d90550) 00010000:00010000:1.0:1789136171.285981:0:23367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000250e6c47/0xedd53ca6b6e474f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.285989:0:23367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000250e6c47/0xedd53ca6b6e474f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.286000:0:23367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000250e6c47/0xedd53ca6b6e474f8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.286019:0:23367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000250e6c47/0xedd53ca6b6e474f8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.286032:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136171.286034:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136171.286036:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789136171.286047:0:25476:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789136171.286052:0:25476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009abe0275/0xedd53ca6b6e474ff lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.286060:0:25476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=709s v=(0 0) 00010000:00010000:3.0:1789136171.286063:0:25476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789136171.286067:0:25476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009abe0275/0xedd53ca6b6e474ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.286076:0:25476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009abe0275/0xedd53ca6b6e474ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.286082:0:25476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009abe0275/0xedd53ca6b6e474ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.286096:0:25476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009abe0275/0xedd53ca6b6e474ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.286116:0:25476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789136171.286220:0:23366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789136171.286225:0:23366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009abe0275/0xedd53ca6b6e474ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.286242:0:23366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff949f4483c400 already unused, calling callback (ffffffffc0d90550) 00010000:00010000:1.0:1789136171.286246:0:23366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009abe0275/0xedd53ca6b6e474ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.286254:0:23366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009abe0275/0xedd53ca6b6e474ff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.286265:0:23366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009abe0275/0xedd53ca6b6e474ff lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.286273:0:23366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009abe0275/0xedd53ca6b6e474ff lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.286287:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136171.286289:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136171.286290:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789136171.286438:0:25476:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789136171.286444:0:25476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc50a84e/0xedd53ca6b6e47506 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.286452:0:25476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=709s v=(0 0) 00010000:00010000:3.0:1789136171.286455:0:25476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789136171.286459:0:25476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc50a84e/0xedd53ca6b6e47506 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.286468:0:25476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc50a84e/0xedd53ca6b6e47506 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.286476:0:25476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc50a84e/0xedd53ca6b6e47506 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.286483:0:25476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc50a84e/0xedd53ca6b6e47506 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.286500:0:25476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789136171.286516:0:23367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789136171.286521:0:23367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc50a84e/0xedd53ca6b6e47506 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.286529:0:23367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff949f4483c800 already unused, calling callback (ffffffffc0d90550) 00010000:00010000:1.0:1789136171.286532:0:23367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc50a84e/0xedd53ca6b6e47506 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.286540:0:23367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc50a84e/0xedd53ca6b6e47506 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.286550:0:23367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc50a84e/0xedd53ca6b6e47506 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.286557:0:23367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc50a84e/0xedd53ca6b6e47506 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.286570:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136171.286571:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136171.286573:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789136171.286818:0:25476:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789136171.286824:0:25476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b168503c/0xedd53ca6b6e4750d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.286836:0:25476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=709s v=(0 0) 00010000:00010000:3.0:1789136171.286839:0:25476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789136171.286842:0:25476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b168503c/0xedd53ca6b6e4750d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.286851:0:25476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b168503c/0xedd53ca6b6e4750d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.286859:0:25476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b168503c/0xedd53ca6b6e4750d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.286865:0:25476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b168503c/0xedd53ca6b6e4750d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.286912:0:25476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789136171.287425:0:25476:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789136171.287432:0:25476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002bb2f7e5/0xedd53ca6b6e47514 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.287441:0:25476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=709s v=(0 0) 00010000:00010000:3.0:1789136171.287444:0:25476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789136171.287448:0:25476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002bb2f7e5/0xedd53ca6b6e47514 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.287457:0:25476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002bb2f7e5/0xedd53ca6b6e47514 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.287477:0:25476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002bb2f7e5/0xedd53ca6b6e47514 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.287484:0:25476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002bb2f7e5/0xedd53ca6b6e47514 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.287591:0:23366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789136171.287597:0:23366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b168503c/0xedd53ca6b6e4750d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.287604:0:23366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff949f4483d800 already unused, calling callback (ffffffffc0d90550) 00010000:00010000:0.0:1789136171.287608:0:23366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b168503c/0xedd53ca6b6e4750d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.287617:0:23366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b168503c/0xedd53ca6b6e4750d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.287663:0:23366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b168503c/0xedd53ca6b6e4750d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.287669:0:23366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b168503c/0xedd53ca6b6e4750d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.287684:0:23366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789136171.287687:0:23366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002bb2f7e5/0xedd53ca6b6e47514 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.287693:0:23366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a0429a8000 already unused, calling callback (ffffffffc0d90550) 00010000:00010000:0.0:1789136171.287695:0:23366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002bb2f7e5/0xedd53ca6b6e47514 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.287701:0:23366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002bb2f7e5/0xedd53ca6b6e47514 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.287710:0:23366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002bb2f7e5/0xedd53ca6b6e47514 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.287717:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136171.287718:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136171.287720:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136171.287800:0:25476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789136171.287805:0:25476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002bb2f7e5/0xedd53ca6b6e47514 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789136171.288116:0:25476:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789136171.288122:0:25476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001917aa93/0xedd53ca6b6e4751b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.288130:0:25476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=709s v=(0 0) 00010000:00010000:3.0:1789136171.288133:0:25476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789136171.288138:0:25476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001917aa93/0xedd53ca6b6e4751b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.288147:0:25476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001917aa93/0xedd53ca6b6e4751b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.288154:0:25476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001917aa93/0xedd53ca6b6e4751b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.288172:0:25476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001917aa93/0xedd53ca6b6e4751b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.288197:0:23367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789136171.288202:0:23367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001917aa93/0xedd53ca6b6e4751b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.288218:0:23367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a07a32c800 already unused, calling callback (ffffffffc0d90550) 00010000:00010000:0.0:1789136171.288239:0:23367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001917aa93/0xedd53ca6b6e4751b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.288249:0:23367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001917aa93/0xedd53ca6b6e4751b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.288260:0:23367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001917aa93/0xedd53ca6b6e4751b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.288267:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136171.288268:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136171.288269:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136171.288344:0:25476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789136171.288349:0:25476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001917aa93/0xedd53ca6b6e4751b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.288570:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789136171.288709:0:25792:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789136171.288715:0:25792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2173068/0xedd53ca6b6e47529 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.288724:0:25792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=709s v=(0 0) 00010000:00010000:0.0:1789136171.288727:0:25792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136171.288731:0:25792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2173068/0xedd53ca6b6e47529 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.288742:0:25792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2173068/0xedd53ca6b6e47529 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.288761:0:25792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2173068/0xedd53ca6b6e47529 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.288768:0:25792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2173068/0xedd53ca6b6e47529 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.288779:0:25792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789136171.289026:0:25476:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789136171.289033:0:25476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbdf23dc/0xedd53ca6b6e47522 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.289041:0:25476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=709s v=(0 0) 00010000:00010000:3.0:1789136171.289045:0:25476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789136171.289049:0:25476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbdf23dc/0xedd53ca6b6e47522 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.289058:0:25476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bbdf23dc/0xedd53ca6b6e47522 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.289066:0:25476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbdf23dc/0xedd53ca6b6e47522 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.289072:0:25476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bbdf23dc/0xedd53ca6b6e47522 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.289094:0:25476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1789136171.289352:0:25792:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789136171.289358:0:25792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5349150/0xedd53ca6b6e47530 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.289365:0:25792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=709s v=(0 0) 00010000:00010000:0.0:1789136171.289368:0:25792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136171.289372:0:25792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5349150/0xedd53ca6b6e47530 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.289381:0:25792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a5349150/0xedd53ca6b6e47530 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.289388:0:25792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5349150/0xedd53ca6b6e47530 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.289395:0:25792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a5349150/0xedd53ca6b6e47530 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.289414:0:25792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1789136171.289691:0:25476:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789136171.289697:0:25476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095852bdd/0xedd53ca6b6e47537 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.289705:0:25476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=709s v=(0 0) 00010000:00010000:3.0:1789136171.289708:0:25476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789136171.289711:0:25476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095852bdd/0xedd53ca6b6e47537 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.289720:0:25476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095852bdd/0xedd53ca6b6e47537 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.289727:0:25476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095852bdd/0xedd53ca6b6e47537 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.289734:0:25476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095852bdd/0xedd53ca6b6e47537 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.289742:0:25476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1789136171.289969:0:25476:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789136171.289975:0:25476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c6863a3/0xedd53ca6b6e4753e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.289982:0:25476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=709s v=(0 0) 00010000:00010000:3.0:1789136171.289991:0:25476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789136171.289995:0:25476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c6863a3/0xedd53ca6b6e4753e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.290003:0:25476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c6863a3/0xedd53ca6b6e4753e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.290010:0:25476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c6863a3/0xedd53ca6b6e4753e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.290017:0:25476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c6863a3/0xedd53ca6b6e4753e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.290024:0:25476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:0.0:1789136171.290335:0:25792:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789136171.290342:0:25792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d77d985/0xedd53ca6b6e47545 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.290350:0:25792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=709s v=(0 0) 00010000:00010000:0.0:1789136171.290353:0:25792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136171.290356:0:25792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d77d985/0xedd53ca6b6e47545 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.290366:0:25792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d77d985/0xedd53ca6b6e47545 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.290374:0:25792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d77d985/0xedd53ca6b6e47545 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.290381:0:25792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004d77d985/0xedd53ca6b6e47545 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.290390:0:25792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:3.0:1789136171.290661:0:25476:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789136171.290668:0:25476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055a93c06/0xedd53ca6b6e4754c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.290676:0:25476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=709s v=(0 0) 00010000:00010000:3.0:1789136171.290679:0:25476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789136171.290682:0:25476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055a93c06/0xedd53ca6b6e4754c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.290691:0:25476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055a93c06/0xedd53ca6b6e4754c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.290699:0:25476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055a93c06/0xedd53ca6b6e4754c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.290712:0:25476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000055a93c06/0xedd53ca6b6e4754c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.290720:0:25476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:0.0:1789136171.290893:0:25792:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789136171.290899:0:25792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000815c9910/0xedd53ca6b6e47553 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.290907:0:25792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=709s v=(0 0) 00010000:00010000:0.0:1789136171.290917:0:25792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136171.290921:0:25792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000815c9910/0xedd53ca6b6e47553 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.290930:0:25792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000815c9910/0xedd53ca6b6e47553 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.290937:0:25792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000815c9910/0xedd53ca6b6e47553 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.290943:0:25792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000815c9910/0xedd53ca6b6e47553 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.290952:0:25792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00010000:00010000:0.0:1789136171.291211:0:23367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:0.0:1789136171.291217:0:23367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2173068/0xedd53ca6b6e47529 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.291240:0:23367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff949f43a18400 already unused, calling callback (ffffffffc0d90550) 00010000:00010000:0.0:1789136171.291244:0:23367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2173068/0xedd53ca6b6e47529 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.291253:0:23367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2173068/0xedd53ca6b6e47529 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.291269:0:23367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2173068/0xedd53ca6b6e47529 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.291288:0:23367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2173068/0xedd53ca6b6e47529 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.291305:0:23367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1789136171.291308:0:23367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bbdf23dc/0xedd53ca6b6e47522 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.291315:0:23367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a07a32dc00 already unused, calling callback (ffffffffc0d90550) 00010000:00010000:0.0:1789136171.291318:0:23367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbdf23dc/0xedd53ca6b6e47522 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.291326:0:23367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbdf23dc/0xedd53ca6b6e47522 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.291337:0:23367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bbdf23dc/0xedd53ca6b6e47522 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.291345:0:23367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bbdf23dc/0xedd53ca6b6e47522 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.291359:0:23367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1789136171.291362:0:23367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a5349150/0xedd53ca6b6e47530 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.291368:0:23367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff949f43a18600 already unused, calling callback (ffffffffc0d90550) 00010000:00010000:0.0:1789136171.291377:0:23367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5349150/0xedd53ca6b6e47530 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.291384:0:23367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5349150/0xedd53ca6b6e47530 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.291394:0:23367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a5349150/0xedd53ca6b6e47530 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.291402:0:23367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a5349150/0xedd53ca6b6e47530 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.291414:0:23367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1789136171.291417:0:23367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095852bdd/0xedd53ca6b6e47537 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.291424:0:23367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a07a32c200 already unused, calling callback (ffffffffc0d90550) 00010000:00010000:0.0:1789136171.291427:0:23367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095852bdd/0xedd53ca6b6e47537 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.291434:0:23367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095852bdd/0xedd53ca6b6e47537 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.291443:0:23367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095852bdd/0xedd53ca6b6e47537 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.291451:0:23367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095852bdd/0xedd53ca6b6e47537 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.291468:0:23367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789136171.291471:0:23367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c6863a3/0xedd53ca6b6e4753e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.291477:0:23367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a07a32d400 already unused, calling callback (ffffffffc0d90550) 00010000:00010000:0.0:1789136171.291480:0:23367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c6863a3/0xedd53ca6b6e4753e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.291488:0:23367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c6863a3/0xedd53ca6b6e4753e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.291498:0:23367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c6863a3/0xedd53ca6b6e4753e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.291505:0:23367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c6863a3/0xedd53ca6b6e4753e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.291517:0:23367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789136171.291520:0:23367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004d77d985/0xedd53ca6b6e47545 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.291527:0:23367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff949f43a19a00 already unused, calling callback (ffffffffc0d90550) 00010000:00010000:0.0:1789136171.291530:0:23367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004d77d985/0xedd53ca6b6e47545 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.291547:0:23367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004d77d985/0xedd53ca6b6e47545 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.291558:0:23367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004d77d985/0xedd53ca6b6e47545 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.291565:0:23367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d77d985/0xedd53ca6b6e47545 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.291577:0:23367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789136171.291581:0:23367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000055a93c06/0xedd53ca6b6e4754c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.291587:0:23367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a07a32d000 already unused, calling callback (ffffffffc0d90550) 00010000:00010000:0.0:1789136171.291590:0:23367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000055a93c06/0xedd53ca6b6e4754c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.291598:0:23367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000055a93c06/0xedd53ca6b6e4754c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.291606:0:23367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000055a93c06/0xedd53ca6b6e4754c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.291613:0:23367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055a93c06/0xedd53ca6b6e4754c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789136171.291958:0:25476:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789136171.291965:0:25476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ccb17e14/0xedd53ca6b6e4755a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.291974:0:25476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=709s v=(0 0) 00010000:00010000:3.0:1789136171.291978:0:25476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789136171.291982:0:25476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ccb17e14/0xedd53ca6b6e4755a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.291992:0:25476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ccb17e14/0xedd53ca6b6e4755a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.292000:0:25476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ccb17e14/0xedd53ca6b6e4755a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.292007:0:25476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ccb17e14/0xedd53ca6b6e4755a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.292016:0:25476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:3.0:1789136171.292060:0:25476:0:(ofd_dev.c:1532:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:34 00000100:00100000:3.0:1789136171.292149:0:25476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a06f1a7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:23403:x1876044587218944:12345-0@lo:5:osp-pre-0-0.0 Request processed in 101947us (102278us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136171.292167:0:25476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:0.0:1789136171.292314:0:23367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789136171.292318:0:23367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000815c9910/0xedd53ca6b6e47553 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.292324:0:23367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff949f43a19e00 already unused, calling callback (ffffffffc0d90550) 00010000:00010000:0.0:1789136171.292327:0:23367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000815c9910/0xedd53ca6b6e47553 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.292334:0:23367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000815c9910/0xedd53ca6b6e47553 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.292345:0:23367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000815c9910/0xedd53ca6b6e47553 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.292351:0:23367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000815c9910/0xedd53ca6b6e47553 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.292360:0:23367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789136171.292363:0:23367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ccb17e14/0xedd53ca6b6e4755a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.292368:0:23367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a07a32cc00 already unused, calling callback (ffffffffc0d90550) 00010000:00010000:0.0:1789136171.292371:0:23367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ccb17e14/0xedd53ca6b6e4755a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.292386:0:23367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ccb17e14/0xedd53ca6b6e4755a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.292395:0:23367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ccb17e14/0xedd53ca6b6e4755a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.292401:0:23367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ccb17e14/0xedd53ca6b6e4755a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.292411:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136171.292412:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136171.292414:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136171.292456:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789136171.292498:0:25792:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789136171.292503:0:25792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7f45504/0xedd53ca6b6e47561 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.292510:0:25792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=709s v=(0 0) 00010000:00010000:0.0:1789136171.292513:0:25792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136171.292517:0:25792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7f45504/0xedd53ca6b6e47561 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.292526:0:25792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c7f45504/0xedd53ca6b6e47561 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.292532:0:25792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7f45504/0xedd53ca6b6e47561 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.292545:0:25792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c7f45504/0xedd53ca6b6e47561 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.292557:0:25792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789136171.292886:0:25792:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789136171.292892:0:25792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008fc1705c/0xedd53ca6b6e47568 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.292901:0:25792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=709s v=(0 0) 00010000:00010000:0.0:1789136171.292904:0:25792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136171.292908:0:25792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008fc1705c/0xedd53ca6b6e47568 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.292917:0:25792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008fc1705c/0xedd53ca6b6e47568 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.292924:0:25792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008fc1705c/0xedd53ca6b6e47568 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.292931:0:25792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008fc1705c/0xedd53ca6b6e47568 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.292945:0:25792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1789136171.293168:0:25792:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789136171.293174:0:25792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043b757fd/0xedd53ca6b6e4756f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.293187:0:25792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=709s v=(0 0) 00010000:00010000:0.0:1789136171.293190:0:25792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136171.293194:0:25792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043b757fd/0xedd53ca6b6e4756f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.293202:0:25792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043b757fd/0xedd53ca6b6e4756f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.293208:0:25792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043b757fd/0xedd53ca6b6e4756f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.293214:0:25792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000043b757fd/0xedd53ca6b6e4756f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.293292:0:25792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1789136171.293531:0:25792:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789136171.293538:0:25792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000945158a8/0xedd53ca6b6e47576 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.293545:0:25792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=709s v=(0 0) 00010000:00010000:0.0:1789136171.293548:0:25792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136171.293552:0:25792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000945158a8/0xedd53ca6b6e47576 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.293561:0:25792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000945158a8/0xedd53ca6b6e47576 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.293581:0:25792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000945158a8/0xedd53ca6b6e47576 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.293588:0:25792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000945158a8/0xedd53ca6b6e47576 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.293595:0:25792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:2.0:1789136171.293861:0:23403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a06f1a70c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:23403:1876044587218944:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1789136171.293877:0:23403:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x22:0x0] 00002000:00010000:0.0:1789136171.293890:0:25792:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789136171.293896:0:25792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b63ba595/0xedd53ca6b6e4757d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.293904:0:25792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=709s v=(0 0) 00010000:00010000:0.0:1789136171.293907:0:25792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136171.293911:0:25792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b63ba595/0xedd53ca6b6e4757d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.293919:0:25792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b63ba595/0xedd53ca6b6e4757d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.293926:0:25792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b63ba595/0xedd53ca6b6e4757d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136171.293931:0:23403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a06f1a70c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:23403:1876044587219968:0@lo:5:osp-pre-0-0.0 00010000:00010000:0.0:1789136171.293932:0:25792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b63ba595/0xedd53ca6b6e4757d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.293950:0:25792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:2.0:1789136171.293974:0:23403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136171.294008:0:23403:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a0819926c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789136171.294151:0:24894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587219968 00000100:00100000:3.0:1789136171.294157:0:24894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587219968 00000100:00100000:3.0:1789136171.294196:0:24894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789136171.294205:0:24894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a06f1a5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:23403:x1876044587219968:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1789136171.294308:0:24894:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00002000:00010000:0.0:1789136171.294485:0:25792:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789136171.294491:0:25792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c520ed1/0xedd53ca6b6e47584 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.296477:0:25792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=709s v=(0 0) 00010000:00010000:0.0:1789136171.296481:0:25792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136171.296489:0:25792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c520ed1/0xedd53ca6b6e47584 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.296505:0:25792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c520ed1/0xedd53ca6b6e47584 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.296516:0:25792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c520ed1/0xedd53ca6b6e47584 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.296524:0:25792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c520ed1/0xedd53ca6b6e47584 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.296538:0:25792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:0.0:1789136171.296826:0:23367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1789136171.296833:0:23367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c7f45504/0xedd53ca6b6e47561 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.296842:0:23367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff949f43a19600 already unused, calling callback (ffffffffc0d90550) 00010000:00010000:0.0:1789136171.296852:0:23367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7f45504/0xedd53ca6b6e47561 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.296861:0:23367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7f45504/0xedd53ca6b6e47561 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.296878:0:23367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c7f45504/0xedd53ca6b6e47561 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.296885:0:23367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c7f45504/0xedd53ca6b6e47561 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.296905:0:23367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1789136171.296909:0:23367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008fc1705c/0xedd53ca6b6e47568 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.296915:0:23367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff949f43a19400 already unused, calling callback (ffffffffc0d90550) 00010000:00010000:0.0:1789136171.296918:0:23367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008fc1705c/0xedd53ca6b6e47568 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.296926:0:23367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008fc1705c/0xedd53ca6b6e47568 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.296937:0:23367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008fc1705c/0xedd53ca6b6e47568 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.296944:0:23367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008fc1705c/0xedd53ca6b6e47568 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.296963:0:23367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789136171.296967:0:23367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000043b757fd/0xedd53ca6b6e4756f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.296973:0:23367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff949f43a19200 already unused, calling callback (ffffffffc0d90550) 00010000:00010000:0.0:1789136171.296976:0:23367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000043b757fd/0xedd53ca6b6e4756f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.296983:0:23367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000043b757fd/0xedd53ca6b6e4756f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.296993:0:23367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000043b757fd/0xedd53ca6b6e4756f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.297000:0:23367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043b757fd/0xedd53ca6b6e4756f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.297011:0:23367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789136171.297014:0:23367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000945158a8/0xedd53ca6b6e47576 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.297019:0:23367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff949f43a18000 already unused, calling callback (ffffffffc0d90550) 00010000:00010000:0.0:1789136171.297022:0:23367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000945158a8/0xedd53ca6b6e47576 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.297039:0:23367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000945158a8/0xedd53ca6b6e47576 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.297048:0:23367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000945158a8/0xedd53ca6b6e47576 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.297055:0:23367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000945158a8/0xedd53ca6b6e47576 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.297066:0:23367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789136171.297069:0:23367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b63ba595/0xedd53ca6b6e4757d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.297074:0:23367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff949f43a18e00 already unused, calling callback (ffffffffc0d90550) 00010000:00010000:0.0:1789136171.297077:0:23367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b63ba595/0xedd53ca6b6e4757d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.297084:0:23367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b63ba595/0xedd53ca6b6e4757d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.297092:0:23367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b63ba595/0xedd53ca6b6e4757d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.297099:0:23367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b63ba595/0xedd53ca6b6e4757d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.297119:0:23367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789136171.297122:0:23367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c520ed1/0xedd53ca6b6e47584 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.297128:0:23367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff949f43a18200 already unused, calling callback (ffffffffc0d90550) 00010000:00010000:0.0:1789136171.297131:0:23367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c520ed1/0xedd53ca6b6e47584 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.297138:0:23367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c520ed1/0xedd53ca6b6e47584 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.297146:0:23367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c520ed1/0xedd53ca6b6e47584 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.297153:0:23367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c520ed1/0xedd53ca6b6e47584 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.297164:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136171.297166:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136171.297168:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136171.297174:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789136171.297941:0:25792:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789136171.297950:0:25792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000405a8253/0xedd53ca6b6e4758b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.297962:0:25792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=709s v=(0 0) 00010000:00010000:0.0:1789136171.297975:0:25792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136171.297980:0:25792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000405a8253/0xedd53ca6b6e4758b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.297991:0:25792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000405a8253/0xedd53ca6b6e4758b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.298000:0:25792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000405a8253/0xedd53ca6b6e4758b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.298006:0:25792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000405a8253/0xedd53ca6b6e4758b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.298020:0:25792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789136171.298158:0:23367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789136171.298163:0:23367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000405a8253/0xedd53ca6b6e4758b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.298170:0:23367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff949f43a19000 already unused, calling callback (ffffffffc0d90550) 00010000:00010000:0.0:1789136171.298173:0:23367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000405a8253/0xedd53ca6b6e4758b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.298180:0:23367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000405a8253/0xedd53ca6b6e4758b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.298192:0:23367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000405a8253/0xedd53ca6b6e4758b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.298209:0:23367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000405a8253/0xedd53ca6b6e4758b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.298239:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136171.298241:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136171.298243:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789136171.298463:0:25792:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789136171.298468:0:25792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e5e4a04/0xedd53ca6b6e47592 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.298478:0:25792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=709s v=(0 0) 00010000:00010000:0.0:1789136171.298481:0:25792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136171.298485:0:25792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e5e4a04/0xedd53ca6b6e47592 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.298494:0:25792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e5e4a04/0xedd53ca6b6e47592 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.298502:0:25792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e5e4a04/0xedd53ca6b6e47592 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.298510:0:25792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e5e4a04/0xedd53ca6b6e47592 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.298534:0:25792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789136171.298754:0:23366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789136171.298760:0:23366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e5e4a04/0xedd53ca6b6e47592 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.298767:0:23366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff949f43a19c00 already unused, calling callback (ffffffffc0d90550) 00010000:00010000:1.0:1789136171.298770:0:23366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e5e4a04/0xedd53ca6b6e47592 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.298789:0:23366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e5e4a04/0xedd53ca6b6e47592 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.298801:0:23366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e5e4a04/0xedd53ca6b6e47592 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.298808:0:23366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e5e4a04/0xedd53ca6b6e47592 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.298822:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136171.298823:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136171.298825:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789136171.299036:0:25792:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789136171.299046:0:25792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067f5ccee/0xedd53ca6b6e47599 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.299054:0:25792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=709s v=(0 0) 00010000:00010000:0.0:1789136171.299057:0:25792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136171.299061:0:25792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067f5ccee/0xedd53ca6b6e47599 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.299069:0:25792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067f5ccee/0xedd53ca6b6e47599 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.299076:0:25792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067f5ccee/0xedd53ca6b6e47599 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.299082:0:25792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000067f5ccee/0xedd53ca6b6e47599 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.299591:0:25792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789136171.300034:0:25792:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789136171.300040:0:25792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000642ece3b/0xedd53ca6b6e475a0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.300050:0:25792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=709s v=(0 0) 00010000:00010000:0.0:1789136171.300053:0:25792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136171.300057:0:25792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000642ece3b/0xedd53ca6b6e475a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.300066:0:25792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000642ece3b/0xedd53ca6b6e475a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.300080:0:25792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000642ece3b/0xedd53ca6b6e475a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.300087:0:25792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000642ece3b/0xedd53ca6b6e475a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789136171.300754:0:24889:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:3.0:1789136171.300792:0:24889:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1789136171.300924:0:24894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a06f1a5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:23403:x1876044587219968:12345-0@lo:5:osp-pre-0-0.0 Request processed in 6717us (6946us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1789136171.300934:0:24894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789136171.300983:0:23403:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:3.0:1789136171.300991:0:23403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a06f1a70c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:23403:1876044587219968:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1789136171.301005:0:23403:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00010000:00010000:1.0:1789136171.301149:0:23367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789136171.301157:0:23367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000067f5ccee/0xedd53ca6b6e47599 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.301166:0:23367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff949f43a18a00 already unused, calling callback (ffffffffc0d90550) 00010000:00010000:1.0:1789136171.301170:0:23367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000067f5ccee/0xedd53ca6b6e47599 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.301179:0:23367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000067f5ccee/0xedd53ca6b6e47599 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.301195:0:23367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000067f5ccee/0xedd53ca6b6e47599 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.301216:0:23367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067f5ccee/0xedd53ca6b6e47599 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.301250:0:23367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789136171.301254:0:23367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000642ece3b/0xedd53ca6b6e475a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.301260:0:23367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff949f43a18c00 already unused, calling callback (ffffffffc0d90550) 00010000:00010000:1.0:1789136171.301263:0:23367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000642ece3b/0xedd53ca6b6e475a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.301270:0:23367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000642ece3b/0xedd53ca6b6e475a0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.301281:0:23367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000642ece3b/0xedd53ca6b6e475a0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.301288:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136171.301289:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136171.301291:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136171.302871:0:25792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789136171.302881:0:25792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000642ece3b/0xedd53ca6b6e475a0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789136171.303498:0:25792:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789136171.303507:0:25792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d1ba6dc/0xedd53ca6b6e475a7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136171.303520:0:25792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=709s v=(0 0) 00010000:00010000:2.0:1789136171.303525:0:25792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789136171.303538:0:25792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d1ba6dc/0xedd53ca6b6e475a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136171.303551:0:25792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d1ba6dc/0xedd53ca6b6e475a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136171.303559:0:25792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d1ba6dc/0xedd53ca6b6e475a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136171.303566:0:25792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002d1ba6dc/0xedd53ca6b6e475a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.304324:0:23366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789136171.304332:0:23366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002d1ba6dc/0xedd53ca6b6e475a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.304342:0:23366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a040031400 already unused, calling callback (ffffffffc0d90550) 00010000:00010000:1.0:1789136171.304355:0:23366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002d1ba6dc/0xedd53ca6b6e475a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.304364:0:23366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002d1ba6dc/0xedd53ca6b6e475a7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.304590:0:23366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002d1ba6dc/0xedd53ca6b6e475a7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.304600:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136171.304602:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136171.304604:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136171.308903:0:25792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789136171.308919:0:25792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d1ba6dc/0xedd53ca6b6e475a7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.311824:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136171.315610:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789136171.315717:0:25792:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789136171.315727:0:25792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000405a8253/0xedd53ca6b6e475ae lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.315742:0:25792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=709s v=(0 0) 00010000:00010000:0.0:1789136171.315746:0:25792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136171.315752:0:25792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000405a8253/0xedd53ca6b6e475ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.315766:0:25792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000405a8253/0xedd53ca6b6e475ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.315776:0:25792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000405a8253/0xedd53ca6b6e475ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.315796:0:25792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000405a8253/0xedd53ca6b6e475ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.316776:0:25792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789136171.317395:0:23367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789136171.317404:0:23367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000405a8253/0xedd53ca6b6e475ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.317416:0:23367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff949f43a19000 already unused, calling callback (ffffffffc0d90550) 00010000:00010000:1.0:1789136171.317421:0:23367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000405a8253/0xedd53ca6b6e475ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.317498:0:23367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000405a8253/0xedd53ca6b6e475ae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.317520:0:23367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000405a8253/0xedd53ca6b6e475ae lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.317527:0:23367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000405a8253/0xedd53ca6b6e475ae lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.317557:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136171.317559:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136171.317560:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789136171.318335:0:25792:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789136171.318345:0:25792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000642ece3b/0xedd53ca6b6e475b5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.318358:0:25792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=709s v=(0 0) 00010000:00010000:0.0:1789136171.318362:0:25792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136171.318368:0:25792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000642ece3b/0xedd53ca6b6e475b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.318378:0:25792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000642ece3b/0xedd53ca6b6e475b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.318387:0:25792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000642ece3b/0xedd53ca6b6e475b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.318394:0:25792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000642ece3b/0xedd53ca6b6e475b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.318415:0:25792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789136171.319295:0:25792:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789136171.319303:0:25792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c520ed1/0xedd53ca6b6e475bc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.319320:0:25792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=709s v=(0 0) 00010000:00010000:0.0:1789136171.319323:0:25792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136171.319328:0:25792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c520ed1/0xedd53ca6b6e475bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.319338:0:25792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c520ed1/0xedd53ca6b6e475bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.319346:0:25792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c520ed1/0xedd53ca6b6e475bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.319353:0:25792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c520ed1/0xedd53ca6b6e475bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.319420:0:25792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1789136171.321300:0:25792:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789136171.321310:0:25792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b63ba595/0xedd53ca6b6e475c3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.321325:0:25792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=709s v=(0 0) 00010000:00010000:0.0:1789136171.321328:0:25792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136171.321334:0:25792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b63ba595/0xedd53ca6b6e475c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.321347:0:25792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b63ba595/0xedd53ca6b6e475c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.321370:0:25792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b63ba595/0xedd53ca6b6e475c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.321378:0:25792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b63ba595/0xedd53ca6b6e475c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.321438:0:23367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789136171.321445:0:23367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000642ece3b/0xedd53ca6b6e475b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.321454:0:23367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff949f43a18c00 already unused, calling callback (ffffffffc0d90550) 00010000:00010000:3.0:1789136171.321458:0:23367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000642ece3b/0xedd53ca6b6e475b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.321467:0:23367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000642ece3b/0xedd53ca6b6e475b5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.321494:0:23367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000642ece3b/0xedd53ca6b6e475b5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.321501:0:23367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000642ece3b/0xedd53ca6b6e475b5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.321521:0:23367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789136171.321524:0:23367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c520ed1/0xedd53ca6b6e475bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.321530:0:23367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff949f43a18200 already unused, calling callback (ffffffffc0d90550) 00010000:00010000:3.0:1789136171.321534:0:23367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c520ed1/0xedd53ca6b6e475bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.321540:0:23367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c520ed1/0xedd53ca6b6e475bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.321549:0:23367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c520ed1/0xedd53ca6b6e475bc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.321555:0:23367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c520ed1/0xedd53ca6b6e475bc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.321567:0:23367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789136171.321570:0:23367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b63ba595/0xedd53ca6b6e475c3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.321583:0:23367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff949f43a18e00 already unused, calling callback (ffffffffc0d90550) 00010000:00010000:3.0:1789136171.321586:0:23367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b63ba595/0xedd53ca6b6e475c3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.321593:0:23367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b63ba595/0xedd53ca6b6e475c3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.321602:0:23367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b63ba595/0xedd53ca6b6e475c3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.321610:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136171.321611:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136171.321613:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136171.325071:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136171.325243:0:25792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789136171.325254:0:25792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b63ba595/0xedd53ca6b6e475c3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789136171.326833:0:25792:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789136171.326844:0:25792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000945158a8/0xedd53ca6b6e475ca lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.326859:0:25792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=709s v=(0 0) 00010000:00010000:0.0:1789136171.326863:0:25792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136171.326870:0:25792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000945158a8/0xedd53ca6b6e475ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.326884:0:25792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000945158a8/0xedd53ca6b6e475ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.326893:0:25792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000945158a8/0xedd53ca6b6e475ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.326913:0:25792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000945158a8/0xedd53ca6b6e475ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.328026:0:23367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789136171.328035:0:23367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000945158a8/0xedd53ca6b6e475ca lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.328046:0:23367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff949f43a18000 already unused, calling callback (ffffffffc0d90550) 00010000:00010000:3.0:1789136171.328050:0:23367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000945158a8/0xedd53ca6b6e475ca lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.328060:0:23367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000945158a8/0xedd53ca6b6e475ca lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.328078:0:23367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000945158a8/0xedd53ca6b6e475ca lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.328229:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136171.328238:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136171.328241:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136171.330257:0:25792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789136171.330270:0:25792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000945158a8/0xedd53ca6b6e475ca lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789136171.331825:0:25792:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789136171.331836:0:25792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043b757fd/0xedd53ca6b6e475d1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.331851:0:25792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=709s v=(0 0) 00010000:00010000:0.0:1789136171.331855:0:25792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136171.331861:0:25792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043b757fd/0xedd53ca6b6e475d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.331876:0:25792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043b757fd/0xedd53ca6b6e475d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.331886:0:25792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043b757fd/0xedd53ca6b6e475d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.331894:0:25792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000043b757fd/0xedd53ca6b6e475d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136171.331971:0:23366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789136171.331979:0:23366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000043b757fd/0xedd53ca6b6e475d1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136171.331987:0:23366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff949f43a19200 already unused, calling callback (ffffffffc0d90550) 00010000:00010000:2.0:1789136171.331992:0:23366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000043b757fd/0xedd53ca6b6e475d1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136171.332001:0:23366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000043b757fd/0xedd53ca6b6e475d1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136171.332026:0:23366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000043b757fd/0xedd53ca6b6e475d1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136171.332036:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136171.332038:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136171.332040:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136171.332555:0:25792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789136171.332561:0:25792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043b757fd/0xedd53ca6b6e475d1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136171.332901:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789136171.332986:0:25792:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789136171.332994:0:25792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008fc1705c/0xedd53ca6b6e475d8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.333003:0:25792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=709s v=(0 0) 00010000:00010000:0.0:1789136171.333006:0:25792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136171.333011:0:25792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008fc1705c/0xedd53ca6b6e475d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.333020:0:25792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008fc1705c/0xedd53ca6b6e475d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.333027:0:25792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008fc1705c/0xedd53ca6b6e475d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.333034:0:25792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008fc1705c/0xedd53ca6b6e475d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136171.333055:0:25792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1789136171.333444:0:25792:0:(ofd_dev.c:1532:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00000100:00100000:0.0:1789136171.333577:0:25792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a07ad9a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:23405:x1876044587219456:12345-0@lo:5:osp-pre-1-0.0 Request processed in 132871us (134479us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136171.333594:0:25792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1789136171.333686:0:23366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789136171.333692:0:23366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008fc1705c/0xedd53ca6b6e475d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136171.333700:0:23366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff949f43a19400 already unused, calling callback (ffffffffc0d90550) 00010000:00010000:2.0:1789136171.333704:0:23366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008fc1705c/0xedd53ca6b6e475d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136171.333713:0:23366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008fc1705c/0xedd53ca6b6e475d8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136171.333728:0:23366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008fc1705c/0xedd53ca6b6e475d8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136171.333735:0:23366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008fc1705c/0xedd53ca6b6e475d8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136171.333751:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136171.333753:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136171.333755:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136171.335738:0:23405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07ad9ad00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:23405:1876044587219456:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1789136171.335757:0:23405:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:3.0:1789136171.335802:0:23405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4402e940 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:23405:1876044587220096:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1789136171.335853:0:23405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136171.337210:0:23405:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a0456239c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789136171.338159:0:24892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587220096 00000100:00100000:0.0:1789136171.338169:0:24892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587220096 00000100:00100000:0.0:1789136171.338266:0:24892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789136171.338277:0:24892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f4402da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:23405:x1876044587220096:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1789136171.338314:0:24892:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00000100:00100000:2.0:1789136171.343429:0:24892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f4402da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:23405:x1876044587220096:12345-0@lo:5:osp-pre-1-0.0 Request processed in 5149us (7570us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1789136171.343440:0:24892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789136171.345318:0:23405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4402e940 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:23405:1876044587220096:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1789136171.345337:0:23405:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 10000000:01000000:1.0:1789136171.952715:0:23375:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789136171.952722:0:23375:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff949f43b2f800 from 14 10000000:01000000:1.0:1789136171.952728:0:23375:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789136171.952768:0:23375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a060037800/0xedd53ca6b6e475df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.952778:0:23375:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.156@tcp lock: ffff94a060037800/0xedd53ca6b6e475df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136171.952789:0:23375:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.156@tcp lock: ffff94a060037800/0xedd53ca6b6e475df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136171.952813:0:23375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07f6ead00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23375:1876044587220224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789136171.952874:0:23375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136171.952915:0:23375:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a075d800c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789136171.955919:0:23373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587220224 00000100:00100000:2.0:1789136171.955932:0:23373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587220224 00000100:00100000:2.0:1789136171.956004:0:23373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789136171.956015:0:23373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0769c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3644072c-bb98-4fbe-9eaf-e40d57d161d0+22:23375:x1876044587220224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789136171.956030:0:23373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789136171.956049:0:23373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94a040031400/0xedd53ca6b6e475e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xedd53ca6b6e475df expref: -99 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136171.956073:0:23373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94a040031400/0xedd53ca6b6e475e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedd53ca6b6e475df expref: 23 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136171.956093:0:23373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94a040031400/0xedd53ca6b6e475e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedd53ca6b6e475df expref: 23 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136171.956101:0:23373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94a040031400, rc 0) 00000100:00100000:2.0:1789136171.956176:0:23373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0769c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3644072c-bb98-4fbe-9eaf-e40d57d161d0+23:23375:x1876044587220224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 163us (3301us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136171.956183:0:23373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789136171.956253:0:23375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07f6ead00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23375:1876044587220224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789136171.956271:0:23375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.156@tcp lock: ffff94a060037800/0xedd53ca6b6e475df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e475e6 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136171.956280:0:23375:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.156@tcp lock: ffff94a060037800/0xedd53ca6b6e475df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xedd53ca6b6e475e6 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136171.956348:0:23375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a06f1a6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23375:1876044587220352:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789136171.956389:0:23375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136171.956419:0:23375:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a050ae79c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789136171.956433:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587220352 00000100:00100000:2.0:1789136171.956436:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587220352 00000100:00100000:2.0:1789136171.956459:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789136171.956465:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0769c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+23:23375:x1876044587220352:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789136171.956480:0:23372:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789136171.956495:0:23372:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789136171.956498:0:23372:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:2.0:1789136171.956569:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0769c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+23:23375:x1876044587220352:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 103us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136171.956576:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789136171.956605:0:23375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a06f1a6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23375:1876044587220352:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789136171.956685:0:23375:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.156@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789136171.956693:0:23375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a060037800/0xedd53ca6b6e475df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e475e6 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136171.956701:0:23375:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.156@tcp lock: ffff94a060037800/0xedd53ca6b6e475df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e475e6 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789136171.956710:0:23375:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789136171.956712:0:23375:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff949f449ce800 from 14 10000000:01000000:2.0:1789136171.956715:0:23375:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789136171.956732:0:23375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a040030200/0xedd53ca6b6e475ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136171.956740:0:23375:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.156@tcp lock: ffff94a040030200/0xedd53ca6b6e475ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136171.956758:0:23375:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.156@tcp lock: ffff94a040030200/0xedd53ca6b6e475ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136171.956771:0:23375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a06f1a6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23375:1876044587220480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789136171.956798:0:23375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136171.956812:0:23375:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a050ae79c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789136171.956823:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587220480 00000100:00100000:2.0:1789136171.956825:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587220480 00000100:00100000:2.0:1789136171.956845:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789136171.956851:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0769c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+23:23375:x1876044587220480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789136171.956858:0:23372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789136171.956866:0:23372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94a040030400/0xedd53ca6b6e475f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xedd53ca6b6e475ed expref: -99 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136171.956880:0:23372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94a040030400/0xedd53ca6b6e475f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedd53ca6b6e475ed expref: 24 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136171.956887:0:23372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94a040030400/0xedd53ca6b6e475f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedd53ca6b6e475ed expref: 24 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136171.956893:0:23372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94a040030400, rc 0) 00000100:00100000:2.0:1789136171.956919:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0769c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+24:23375:x1876044587220480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 69us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136171.956926:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789136171.956955:0:23375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a06f1a6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23375:1876044587220480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789136171.956965:0:23375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.156@tcp lock: ffff94a040030200/0xedd53ca6b6e475ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e475f4 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136171.956986:0:23375:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.156@tcp lock: ffff94a040030200/0xedd53ca6b6e475ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xedd53ca6b6e475f4 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136171.957022:0:23375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a06f1a6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23375:1876044587220608:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789136171.957048:0:23375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136171.957061:0:23375:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a050ae79c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789136171.957071:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587220608 00000100:00100000:2.0:1789136171.957074:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587220608 00000100:00100000:2.0:1789136171.957092:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789136171.957098:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0769c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+24:23375:x1876044587220608:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789136171.957107:0:23372:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789136171.957117:0:23372:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789136171.957119:0:23372:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:2.0:1789136171.957173:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0769c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+24:23375:x1876044587220608:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 75us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136171.957179:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789136171.957204:0:23375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a06f1a6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23375:1876044587220608:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789136171.957250:0:23375:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.156@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789136171.957256:0:23375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a040030200/0xedd53ca6b6e475ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e475f4 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136171.957264:0:23375:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.156@tcp lock: ffff94a040030200/0xedd53ca6b6e475ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e475f4 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136172.339593:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789136172.917131:0:24136:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789136173.361302:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136174.391489:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136175.408865:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789136176.115858:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789136176.115879:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a06f1a6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876044587220736:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789136176.115952:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136176.116014:0:24896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587220736 00000100:00100000:2.0:1789136176.116021:0:24896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587220736 00000100:00100000:2.0:1789136176.116071:0:24896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789136176.116080:0:24896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a06f1a70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876044587220736:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789136176.116126:0:24896:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915845632 avail 3684323328 00000100:00100000:2.0:1789136176.116168:0:24896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a06f1a70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876044587220736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136176.116175:0:24896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1789136176.116193:0:23374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789136176.116238:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a06f1a6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876044587220736:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789136176.117474:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789136176.117492:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07f6eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876044587220864:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789136176.117542:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136176.117578:0:24123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587220864 00000100:00100000:0.0:1789136176.117584:0:24123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587220864 00000100:00100000:0.0:1789136176.117621:0:24123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789136176.117652:0:24123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a07ad98b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876044587220864:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789136176.117683:0:24123:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1789136176.117725:0:24123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a07ad98b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876044587220864:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136176.117732:0:24123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789136176.117766:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07f6eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876044587220864:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789136176.117839:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07f6eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876044587220992:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789136176.117869:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136176.117942:0:23383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587220992 00000100:00100000:0.0:1789136176.117946:0:23383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587220992 00000100:00100000:0.0:1789136176.117979:0:23383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789136176.117985:0:23383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f4402c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876044587220992:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789136176.118002:0:23383:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789136176.118037:0:23383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f4402c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876044587220992:12345-0@lo:41:osp-pre-1-0.0 Request processed in 53us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136176.118042:0:23383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789136176.118083:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07f6eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876044587220992:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789136176.435158:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789136176.616839:0:26069:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg656-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1789136176.627114:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f443683c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876044587221120:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789136176.627180:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136176.627243:0:24896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587221120 00000100:00100000:3.0:1789136176.627250:0:24896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587221120 00000100:00100000:3.0:1789136176.627300:0:24896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789136176.627309:0:24896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f44368f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876044587221120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789136176.627330:0:24896:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915845632 avail 3684323328 00000100:00100000:3.0:1789136176.627371:0:24896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f44368f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876044587221120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136176.627389:0:24896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1789136176.627410:0:23374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789136176.627443:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f443683c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876044587221120:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789136176.628120:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07f6e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876044587221248:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789136176.628158:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136176.628179:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07f6eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876044587221760:0@lo:400:kworker.0 00000100:00100000:3.0:1789136176.628225:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136176.628243:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a076a2fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876044587222272:0@lo:400:kworker.0 00000100:00100000:3.0:1789136176.628265:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136176.628285:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789136176.628292:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07f6e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876044587221376:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789136176.628312:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136176.628327:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07f6e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876044587221888:0@lo:400:kworker.0 00000100:00100000:3.0:1789136176.628348:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136176.628362:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a076a2cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876044587222400:0@lo:400:kworker.0 00000100:00100000:3.0:1789136176.628382:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136176.628408:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07f6e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3644072c-bb98-4fbe-9eaf-e40d57d161d0:3647:1876044587221504:0@lo:400:kworker.0 00000100:00100000:3.0:1789136176.628435:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136176.628460:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07f6ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876044587222016:0@lo:400:kworker.0 00000100:00100000:3.0:1789136176.628479:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136176.628493:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a076a2cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876044587222528:0@lo:400:kworker.0 00000100:00100000:3.0:1789136176.628512:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136176.628527:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789136176.628540:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07f6eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876044587221632:0@lo:400:kworker.0 00000100:00100000:3.0:1789136176.628561:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136176.628576:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a076a2e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876044587222144:0@lo:400:kworker.0 00000100:00100000:3.0:1789136176.628598:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136176.628620:0:24896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587221248 00000100:00100000:3.0:1789136176.628648:0:24896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587221248 00000100:00100000:3.0:1789136176.628678:0:24896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587221376 00000100:00100000:3.0:1789136176.628681:0:24896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587221376 00000100:00100000:3.0:1789136176.628696:0:24896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789136176.628703:0:24896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f443683c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876044587221248:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789136176.628726:0:24896:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1789136176.628773:0:24896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f443683c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876044587221248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136176.628780:0:24896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789136176.628794:0:24896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789136176.628801:0:24896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f44369680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1876044587221376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789136176.628811:0:24896:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1789136176.628835:0:24896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f44369680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1876044587221376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 35us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136176.628841:0:24896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789136176.628857:0:24752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587221760 00000100:00100000:3.0:1789136176.628860:0:24752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587221760 00000100:00100000:3.0:1789136176.628878:0:24752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587222272 00000100:00100000:3.0:1789136176.628880:0:24752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587222272 00000100:00100000:3.0:1789136176.628892:0:24752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587222400 00000100:00100000:3.0:1789136176.628894:0:24752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587222400 00000100:00100000:3.0:1789136176.628907:0:24752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587222016 00000100:00100000:3.0:1789136176.628909:0:24752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587222016 00000100:00100000:3.0:1789136176.628932:0:24752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587222528 00000100:00100000:3.0:1789136176.628934:0:24752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587222528 00000100:00100000:3.0:1789136176.628945:0:24752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587222144 00000100:00100000:3.0:1789136176.628948:0:24752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587222144 00000100:00100000:3.0:1789136176.628960:0:24752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789136176.628966:0:24752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f44368780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876044587221760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136176.629012:0:24752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f44368780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876044587221760:12345-0@lo:400:kworker.0 Request processed in 46us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136176.629018:0:24752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789136176.629032:0:24752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789136176.629038:0:24752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f4436b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876044587222272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136176.629065:0:24752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f4436b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876044587222272:12345-0@lo:400:kworker.0 Request processed in 29us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136176.629070:0:24752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789136176.629081:0:24752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789136176.629087:0:24752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f4436bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876044587222400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136176.629114:0:24752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f4436bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876044587222400:12345-0@lo:400:kworker.0 Request processed in 27us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136176.629120:0:24752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789136176.629131:0:24752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789136176.629137:0:24752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f4436b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876044587222016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136176.629166:0:24752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f4436b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876044587222016:12345-0@lo:400:kworker.0 Request processed in 29us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136176.629172:0:24752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789136176.629184:0:24752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789136176.629191:0:24752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0622e9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876044587222528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136176.633423:0:24752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0622e9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876044587222528:12345-0@lo:400:kworker.0 Request processed in 4224us (4900us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136176.633438:0:24752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789136176.633473:0:24752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789136176.633485:0:24752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0622eb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876044587222144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136176.633537:0:24752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0622eb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876044587222144:12345-0@lo:400:kworker.0 Request processed in 56us (4937us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136176.633543:0:24752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789136176.633576:0:24895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587221888 00000100:00100000:3.0:1789136176.633583:0:24895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587221888 00000100:00100000:3.0:1789136176.633616:0:24895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587221632 00000100:00100000:3.0:1789136176.633619:0:24895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587221632 00000100:00100000:3.0:1789136176.633659:0:24895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789136176.633666:0:24895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f44368000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876044587221888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136176.633698:0:24895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f44368000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876044587221888:12345-0@lo:400:kworker.0 Request processed in 33us (5349us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136176.633704:0:24895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789136176.633715:0:24895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789136176.633721:0:24895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0622ebc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3647:x1876044587221632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136176.633748:0:24895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0622ebc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3647:x1876044587221632:12345-0@lo:400:kworker.0 Request processed in 28us (5185us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136176.633753:0:24895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789136176.634298:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587221504 00000100:00100000:3.0:1789136176.634304:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587221504 00000100:00100000:3.0:1789136176.634334:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789136176.634340:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0769c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+24:3647:x1876044587221504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136176.634386:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0769c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+24:3647:x1876044587221504:12345-0@lo:400:kworker.0 Request processed in 46us (5950us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136176.634393:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:3.0:1789136176.634428:0:23374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789136176.634433:0:23374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789136176.634436:0:23374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789136176.634480:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07f6e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876044587221376:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789136176.634494:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07f6e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876044587221888:0@lo:400:kworker.0 00010000:00080000:3.0:1789136176.634508:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94a076a2cb40 x1876044587222400/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136176.634518:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a076a2cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876044587222400:0@lo:400:kworker.0 00000100:00100000:3.0:1789136176.634531:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07f6e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876044587221248:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1789136176.634543:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94a07f6eb840 x1876044587221760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136176.634552:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07f6eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876044587221760:0@lo:400:kworker.0 00010000:00080000:3.0:1789136176.634562:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94a076a2fc00 x1876044587222272/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136176.634571:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a076a2fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876044587222272:0@lo:400:kworker.0 00000100:00100000:3.0:1789136176.634615:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07f6eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876044587221632:0@lo:400:kworker.0 00010000:00080000:3.0:1789136176.634625:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94a076a2e580 x1876044587222144/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136176.634664:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a076a2e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876044587222144:0@lo:400:kworker.0 00000100:00100000:3.0:1789136176.634683:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07f6e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3644072c-bb98-4fbe-9eaf-e40d57d161d0:3647:1876044587221504:0@lo:400:kworker.0 00010000:00080000:3.0:1789136176.634694:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94a07f6ead00 x1876044587222016/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136176.634703:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07f6ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876044587222016:0@lo:400:kworker.0 00010000:00080000:3.0:1789136176.634713:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94a076a2cf00 x1876044587222528/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136176.634720:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a076a2cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876044587222528:0@lo:400:kworker.0 00000001:00080000:0.0:1789136176.636090:0:25711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00010000:00010000:1.0:1789136177.459587:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789136177.540930:0:26123:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789136177.541118:0:26123:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:2.0:1789136178.463574:0:26173:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789136178.463853:0:26173:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789136178.483427:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789136178.800447:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:1.0:1789136178.800546:0:23371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567171072 00000100:00100000:1.0:1789136178.800556:0:23371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567171072 00000100:00100000:1.0:1789136178.800603:0:23371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 115 00000100:00100000:1.0:1789136178.800683:0:23371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0769c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2394:x1876044567171072:12345-192.168.206.56@tcp:250:mount.lustre.0 00010000:00080000:1.0:1789136178.800712:0:23371:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from bbab00a5-62cb-4304-af69-c2de8be80f81@192.168.206.56@tcp t0 exp 0000000000000000 cur 716 last 0 00000020:00000080:1.0:1789136178.800740:0:23371:0:(genops.c:1385:class_connect()) connect: client bbab00a5-62cb-4304-af69-c2de8be80f81, cookie 0xedd53ca6b6e475fb 00000100:00080000:1.0:1789136178.800896:0:23371:0:(import.c:65:import_set_state_nolock()) ffff949f4509e800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789136178.800974:0:23371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0769c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbab00a5-62cb-4304-af69-c2de8be80f81+5:2394:x1876044567171072:12345-192.168.206.56@tcp:250:mount.lustre.0 Request processed in 292us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136178.800982:0:23371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 115 00000100:00100000:3.0:1789136178.823578:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:2.0:1789136178.823769:0:23373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567171200 00000100:00100000:2.0:1789136178.823778:0:23373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567171200 00000100:00100000:2.0:1789136178.823836:0:23373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 116 00000100:00100000:2.0:1789136178.823846:0:23373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a045424c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbab00a5-62cb-4304-af69-c2de8be80f81+5:18323:x1876044567171200:12345-192.168.206.56@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789136178.823864:0:23373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789136178.823880:0:23373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94a040031c00/0xedd53ca6b6e47602 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x19d4d74b7ccf48cf expref: -99 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136178.823910:0:23373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94a040031c00/0xedd53ca6b6e47602 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf48cf expref: 6 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136178.823922:0:23373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94a040031c00/0xedd53ca6b6e47602 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf48cf expref: 6 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136178.823946:0:23373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94a040031c00, rc 0) 00000100:00100000:2.0:1789136178.824014:0:23373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a045424c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbab00a5-62cb-4304-af69-c2de8be80f81+6:18323:x1876044567171200:12345-192.168.206.56@tcp:101:mount.lustre.0 Request processed in 169us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136178.824022:0:23373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 116 00000100:00100000:0.0:1789136178.836424:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:3.0:1789136178.842659:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567171328 00000100:00100000:3.0:1789136178.842675:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567171328 00000100:00100000:3.0:1789136178.842750:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 117 00000100:00100000:3.0:1789136178.842761:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a045427850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbab00a5-62cb-4304-af69-c2de8be80f81+6:18323:x1876044567171328:12345-192.168.206.56@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789136178.842883:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a045427850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbab00a5-62cb-4304-af69-c2de8be80f81+6:18323:x1876044567171328:12345-192.168.206.56@tcp:501:mount.lustre.0 Request processed in 124us (6471us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789136178.842892:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 117 00000100:00100000:0.0:1789136178.846552:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:1.0:1789136178.846663:0:23371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567171456 00000100:00100000:1.0:1789136178.846671:0:23371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567171456 00000100:00100000:1.0:1789136178.846720:0:23371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 118 00000100:00100000:1.0:1789136178.846728:0:23371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a045426050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbab00a5-62cb-4304-af69-c2de8be80f81+6:18323:x1876044567171456:12345-192.168.206.56@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789136178.846743:0:23371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789136178.846759:0:23371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94a060036e00/0xedd53ca6b6e47609 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x19d4d74b7ccf48d6 expref: -99 pid: 23371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136178.846783:0:23371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94a060036e00/0xedd53ca6b6e47609 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf48d6 expref: 7 pid: 23371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136178.846794:0:23371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94a060036e00/0xedd53ca6b6e47609 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf48d6 expref: 7 pid: 23371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136178.846803:0:23371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94a060036e00, rc 0) 00000100:00100000:1.0:1789136178.846852:0:23371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a045426050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbab00a5-62cb-4304-af69-c2de8be80f81+7:18323:x1876044567171456:12345-192.168.206.56@tcp:101:mount.lustre.0 Request processed in 125us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136178.846859:0:23371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 118 00000100:00100000:0.0:1789136178.854306:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:2.0:1789136178.857868:0:23373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567171584 00000100:00100000:2.0:1789136178.857882:0:23373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567171584 00000100:00100000:2.0:1789136178.857950:0:23373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 119 00000100:00100000:2.0:1789136178.857959:0:23373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a045427050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbab00a5-62cb-4304-af69-c2de8be80f81+7:18323:x1876044567171584:12345-192.168.206.56@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789136178.858129:0:23373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a045427050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbab00a5-62cb-4304-af69-c2de8be80f81+8:18323:x1876044567171584:12345-192.168.206.56@tcp:501:mount.lustre.0 Request processed in 170us (3831us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136178.858137:0:23373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 119 00000100:00100000:0.0:1789136178.860438:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:3.0:1789136178.860674:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567171712 00000100:00100000:3.0:1789136178.860683:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567171712 00000100:00100000:3.0:1789136178.860738:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 120 00000100:00100000:3.0:1789136178.860749:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a045424450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbab00a5-62cb-4304-af69-c2de8be80f81+8:18323:x1876044567171712:12345-192.168.206.56@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789136178.860903:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a045424450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbab00a5-62cb-4304-af69-c2de8be80f81+8:18323:x1876044567171712:12345-192.168.206.56@tcp:503:mount.lustre.0 Request processed in 155us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136178.860911:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 120 00000040:00080000:3.0:1789136178.865705:0:23417:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789136178.873739:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:2.0:1789136178.875870:0:23371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567171840 00000100:00100000:2.0:1789136178.875883:0:23371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567171840 00000100:00100000:2.0:1789136178.875951:0:23371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 121 00000100:00100000:2.0:1789136178.875960:0:23371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a045425850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbab00a5-62cb-4304-af69-c2de8be80f81+8:18342:x1876044567171840:12345-192.168.206.56@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789136178.876115:0:23371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a045425850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbab00a5-62cb-4304-af69-c2de8be80f81+8:18342:x1876044567171840:12345-192.168.206.56@tcp:502:llog_process_th.0 Request processed in 155us (2384us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136178.876122:0:23371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 121 00000100:00100000:0.0:1789136178.906007:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:2.0:1789136178.906532:0:23373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567171968 00000100:00100000:2.0:1789136178.906547:0:23373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567171968 00000100:00100000:2.0:1789136178.906666:0:23373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 122 00000100:00100000:2.0:1789136178.906678:0:23373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a045426c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbab00a5-62cb-4304-af69-c2de8be80f81+8:18342:x1876044567171968:12345-192.168.206.56@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789136178.906888:0:23373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a045426c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbab00a5-62cb-4304-af69-c2de8be80f81+8:18342:x1876044567171968:12345-192.168.206.56@tcp:502:llog_process_th.0 Request processed in 211us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136178.906909:0:23373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 122 00000100:00100000:0.0:1789136178.923822:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:3.0:1789136178.924323:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567172096 00000100:00100000:3.0:1789136178.924337:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567172096 00000100:00100000:3.0:1789136178.924623:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 123 00000100:00100000:3.0:1789136178.924671:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a045424050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbab00a5-62cb-4304-af69-c2de8be80f81+8:18342:x1876044567172096:12345-192.168.206.56@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789136178.924898:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a045424050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbab00a5-62cb-4304-af69-c2de8be80f81+8:18342:x1876044567172096:12345-192.168.206.56@tcp:502:llog_process_th.0 Request processed in 230us (1089us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136178.924907:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 123 00000100:00100000:3.0:1789136178.929749:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:1.0:1789136178.930540:0:23371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567172224 00000100:00100000:1.0:1789136178.930573:0:23371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567172224 00000100:00100000:1.0:1789136178.930669:0:23371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 124 00000100:00100000:1.0:1789136178.930682:0:23371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a045427450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbab00a5-62cb-4304-af69-c2de8be80f81+8:18323:x1876044567172224:12345-192.168.206.56@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789136178.930707:0:23371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789136178.930732:0:23371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94a060037e00/0xedd53ca6b6e47610 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x19d4d74b7ccf4907 expref: -99 pid: 23371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136178.931425:0:23371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94a060037e00/0xedd53ca6b6e47610 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4907 expref: 9 pid: 23371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136178.931582:0:23371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94a060037e00/0xedd53ca6b6e47610 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4907 expref: 9 pid: 23371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136178.931594:0:23371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94a060037e00, rc 0) 00000100:00100000:1.0:1789136178.931699:0:23371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a045427450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbab00a5-62cb-4304-af69-c2de8be80f81+9:18323:x1876044567172224:12345-192.168.206.56@tcp:101:mount.lustre.0 Request processed in 1019us (1965us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136178.931708:0:23371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 124 00000100:00100000:0.0:1789136178.936693:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:3.0:1789136178.937293:0:23373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567172352 00000100:00100000:3.0:1789136178.937306:0:23373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567172352 00000100:00100000:3.0:1789136178.937378:0:23373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 125 00000100:00100000:3.0:1789136178.937390:0:23373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a045427c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbab00a5-62cb-4304-af69-c2de8be80f81+9:18323:x1876044567172352:12345-192.168.206.56@tcp:256:mount.lustre.0 20000000:01000000:3.0:1789136178.937539:0:23373:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789136178.937576:0:23373:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789136178.937581:0:23373:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789136178.937584:0:23373:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789136178.937588:0:23373:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1789136178.937591:0:23373:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:2.0:1789136178.940537:0:23373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a045427c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbab00a5-62cb-4304-af69-c2de8be80f81+9:18323:x1876044567172352:12345-192.168.206.56@tcp:256:mount.lustre.0 Request processed in 3132us (3842us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136178.940554:0:23373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 125 00000100:00100000:1.0:1789136178.945064:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:3.0:1789136178.945523:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567172480 00000100:00100000:3.0:1789136178.945537:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567172480 00000100:00100000:3.0:1789136178.945712:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 126 00000100:00100000:3.0:1789136178.945726:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a045424850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbab00a5-62cb-4304-af69-c2de8be80f81+9:18323:x1876044567172480:12345-192.168.206.56@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789136178.945751:0:23372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789136178.945776:0:23372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94a07a32ce00/0xedd53ca6b6e47617 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x19d4d74b7ccf490e expref: -99 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136178.945813:0:23372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94a07a32ce00/0xedd53ca6b6e47617 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf490e expref: 10 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136178.945847:0:23372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94a07a32ce00/0xedd53ca6b6e47617 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf490e expref: 10 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136178.945859:0:23372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94a07a32ce00, rc 0) 00000100:00100000:3.0:1789136178.945937:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a045424850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbab00a5-62cb-4304-af69-c2de8be80f81+10:18323:x1876044567172480:12345-192.168.206.56@tcp:101:mount.lustre.0 Request processed in 214us (900us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136178.945945:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 126 00000100:00100000:0.0:1789136178.948668:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:2.0:1789136178.948828:0:23373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567172608 00000100:00100000:2.0:1789136178.948841:0:23373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567172608 00000100:00100000:2.0:1789136178.948906:0:23373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 127 00000100:00100000:2.0:1789136178.948918:0:23373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a045426450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbab00a5-62cb-4304-af69-c2de8be80f81+10:18323:x1876044567172608:12345-192.168.206.56@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789136178.949144:0:23373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a045426450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbab00a5-62cb-4304-af69-c2de8be80f81+10:18323:x1876044567172608:12345-192.168.206.56@tcp:501:mount.lustre.0 Request processed in 227us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136178.949153:0:23373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 127 00000100:00100000:0.0:1789136178.951823:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:3.0:1789136178.951913:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567172736 00000100:00100000:3.0:1789136178.951924:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567172736 00000100:00100000:3.0:1789136178.951991:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 128 00000100:00100000:3.0:1789136178.952004:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a08199a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbab00a5-62cb-4304-af69-c2de8be80f81+10:18323:x1876044567172736:12345-192.168.206.56@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789136178.952229:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a08199a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbab00a5-62cb-4304-af69-c2de8be80f81+10:18323:x1876044567172736:12345-192.168.206.56@tcp:503:mount.lustre.0 Request processed in 227us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136178.952238:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 128 00000100:00100000:3.0:1789136178.955904:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:1.0:1789136178.956461:0:23371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567172864 00000100:00100000:1.0:1789136178.956474:0:23371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567172864 00000100:00100000:1.0:1789136178.956550:0:23371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 129 00000100:00100000:1.0:1789136178.956562:0:23371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a081999850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbab00a5-62cb-4304-af69-c2de8be80f81+10:18347:x1876044567172864:12345-192.168.206.56@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789136178.956813:0:23371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a081999850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbab00a5-62cb-4304-af69-c2de8be80f81+10:18347:x1876044567172864:12345-192.168.206.56@tcp:502:llog_process_th.0 Request processed in 253us (922us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136178.956822:0:23371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 129 00000100:00100000:0.0:1789136178.961433:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:2.0:1789136178.961553:0:23373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567172992 00000100:00100000:2.0:1789136178.961564:0:23373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567172992 00000100:00100000:2.0:1789136178.961678:0:23373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 130 00000100:00100000:2.0:1789136178.961690:0:23373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a08199bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbab00a5-62cb-4304-af69-c2de8be80f81+10:18347:x1876044567172992:12345-192.168.206.56@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789136178.961901:0:23373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a08199bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbab00a5-62cb-4304-af69-c2de8be80f81+10:18347:x1876044567172992:12345-192.168.206.56@tcp:502:llog_process_th.0 Request processed in 212us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136178.961910:0:23373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 130 00000100:00100000:0.0:1789136178.974199:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:3.0:1789136178.980739:0:24752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567173120 00000100:00100000:3.0:1789136178.980865:0:24752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567173120 00000100:00100000:3.0:1789136178.981482:0:24752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 7 00000100:00100000:3.0:1789136178.981494:0:24752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a07ad98f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2394:x1876044567173120:12345-192.168.206.56@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789136178.981526:0:24752:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from d8be90b6-0a63-4a05-9b5e-0fab1488262f@192.168.206.56@tcp t0 exp 0000000000000000 cur 717 last 0 00000020:00000080:3.0:1789136178.981768:0:24752:0:(genops.c:1385:class_connect()) connect: client d8be90b6-0a63-4a05-9b5e-0fab1488262f, cookie 0xedd53ca6b6e4761e 00000004:00100000:3.0:1789136178.981792:0:24752:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789136178.981989:0:24752:0:(import.c:65:import_set_state_nolock()) ffff94a0819e1000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789136178.982281:0:24752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a07ad98f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8be90b6-0a63-4a05-9b5e-0fab1488262f+6:2394:x1876044567173120:12345-192.168.206.56@tcp:38:mount.lustre.0 Request processed in 779us (8105us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136178.982309:0:24752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 7 00000100:00100000:2.0:1789136178.984966:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:3.0:1789136178.986513:0:23380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567173376 00000100:00100000:3.0:1789136178.986529:0:23380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567173376 00000100:00100000:3.0:1789136178.986590:0:23380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 8 00000100:00100000:3.0:1789136178.986599:0:23380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a06f1a6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2394:x1876044567173376:12345-192.168.206.56@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789136178.986873:0:23380:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from d8be90b6-0a63-4a05-9b5e-0fab1488262f@192.168.206.56@tcp t0 exp 0000000000000000 cur 717 last 0 00000020:00000080:3.0:1789136178.986933:0:23380:0:(genops.c:1385:class_connect()) connect: client d8be90b6-0a63-4a05-9b5e-0fab1488262f, cookie 0xedd53ca6b6e47625 00000004:00100000:3.0:1789136178.986957:0:23380:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789136178.988727:0:23380:0:(import.c:65:import_set_state_nolock()) ffff949f42baa000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789136178.988929:0:23380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a06f1a6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8be90b6-0a63-4a05-9b5e-0fab1488262f+6:2394:x1876044567173376:12345-192.168.206.56@tcp:38:mount.lustre.0 Request processed in 2328us (3971us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136178.988940:0:23380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 8 00000100:00100000:3.0:1789136178.989059:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:3.0:1789136178.989167:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:3.0:1789136178.989203:0:24752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567173248 00000100:00100000:3.0:1789136178.989210:0:24752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567173248 00000100:00100000:3.0:1789136178.989253:0:24752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567173632 00000100:00100000:3.0:1789136178.989256:0:24752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567173632 00000100:00100000:3.0:1789136178.989272:0:24752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 9 00000100:00100000:3.0:1789136178.989548:0:24752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0622e92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8be90b6-0a63-4a05-9b5e-0fab1488262f+7:0:x1876044567173248:12345-192.168.206.56@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789136178.989583:0:24752:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1789136178.989705:0:24752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0622e92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8be90b6-0a63-4a05-9b5e-0fab1488262f+7:0:x1876044567173248:12345-192.168.206.56@tcp:41:mount.lustre.0 Request processed in 424us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136178.989713:0:24752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 9 00000100:00100000:3.0:1789136178.989730:0:24752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 10 00000100:00100000:3.0:1789136178.989737:0:24752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0622e83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8be90b6-0a63-4a05-9b5e-0fab1488262f+6:18323:x1876044567173632:12345-192.168.206.56@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789136178.989748:0:24752:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1789136178.989770:0:24752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0622e83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8be90b6-0a63-4a05-9b5e-0fab1488262f+6:18323:x1876044567173632:12345-192.168.206.56@tcp:41:mount.lustre.0 Request processed in 34us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136178.989927:0:24752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 10 00000100:00080000:3.0:1789136178.989949:0:23374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789136179.002068:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:1.0:1789136179.002155:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:3.0:1789136179.005843:0:24752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567173760 00000100:00100000:3.0:1789136179.005858:0:24752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567173760 00000100:00100000:2.0:1789136179.006749:0:23378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567173504 00000100:00100000:2.0:1789136179.006770:0:23378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567173504 00000100:00100000:2.0:1789136179.006900:0:23378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 11 00000100:00100000:2.0:1789136179.006910:0:23378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a076a2f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8be90b6-0a63-4a05-9b5e-0fab1488262f+6:0:x1876044567173504:12345-192.168.206.56@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789136179.006948:0:23378:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789136179.007044:0:23378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a076a2f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8be90b6-0a63-4a05-9b5e-0fab1488262f+6:0:x1876044567173504:12345-192.168.206.56@tcp:41:mount.lustre.0 Request processed in 134us (4887us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136179.007052:0:23378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 11 00000100:00100000:2.0:1789136179.007101:0:24752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 12 00000100:00100000:2.0:1789136179.007109:0:24752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a076a2da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8be90b6-0a63-4a05-9b5e-0fab1488262f+6:18323:x1876044567173760:12345-192.168.206.56@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789136179.007141:0:24752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a076a2da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8be90b6-0a63-4a05-9b5e-0fab1488262f+6:18323:x1876044567173760:12345-192.168.206.56@tcp:40:mount.lustre.0 Request processed in 33us (5084us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136179.007148:0:24752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 12 00000100:00080000:3.0:1789136179.009699:0:23374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789136179.019062:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:0.0:1789136179.019114:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:2.0:1789136179.019220:0:24892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567173888 00000100:00100000:2.0:1789136179.019230:0:24892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567173888 00000100:00100000:2.0:1789136179.019276:0:24892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567174016 00000100:00100000:2.0:1789136179.019280:0:24892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567174016 00000100:00100000:2.0:1789136179.019321:0:24892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 16 00000100:00100000:2.0:1789136179.019329:0:24892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a07ad98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2394:x1876044567173888:12345-192.168.206.56@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789136179.019368:0:24892:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from d8be90b6-0a63-4a05-9b5e-0fab1488262f@192.168.206.56@tcp t0 exp 0000000000000000 cur 717 last 0 00000020:00000080:2.0:1789136179.019399:0:24892:0:(genops.c:1385:class_connect()) connect: client d8be90b6-0a63-4a05-9b5e-0fab1488262f, cookie 0xedd53ca6b6e4762c 00002000:00100000:2.0:1789136179.019411:0:24892:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d8be90b6-0a63-4a05-9b5e-0fab1488262f/ffff949f42bac800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113983 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789136179.019430:0:24892:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789136179.019609:0:24892:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789136179.019670:0:24892:0:(import.c:65:import_set_state_nolock()) ffff949f42baa800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789136179.019747:0:24892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a07ad98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d8be90b6-0a63-4a05-9b5e-0fab1488262f+6:2394:x1876044567173888:12345-192.168.206.56@tcp:8:mount.lustre.0 Request processed in 416us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136179.019767:0:24892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 16 00000100:00100000:1.0:1789136179.019885:0:25476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 17 00000100:00100000:1.0:1789136179.019891:0:25476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a07ad983c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2394:x1876044567174016:12345-192.168.206.56@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789136179.019910:0:25476:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from d8be90b6-0a63-4a05-9b5e-0fab1488262f@192.168.206.56@tcp t0 exp 0000000000000000 cur 717 last 0 00000020:00000080:1.0:1789136179.019927:0:25476:0:(genops.c:1385:class_connect()) connect: client d8be90b6-0a63-4a05-9b5e-0fab1488262f, cookie 0xedd53ca6b6e47633 00002000:00100000:1.0:1789136179.019933:0:25476:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d8be90b6-0a63-4a05-9b5e-0fab1488262f/ffff949f45099800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113983 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789136179.019945:0:25476:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789136179.020069:0:25476:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789136179.020086:0:25476:0:(import.c:65:import_set_state_nolock()) ffff949f45099000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789136179.020112:0:25476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a07ad983c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d8be90b6-0a63-4a05-9b5e-0fab1488262f+6:2394:x1876044567174016:12345-192.168.206.56@tcp:8:mount.lustre.0 Request processed in 220us (997us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136179.020119:0:25476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 17 00000100:00100000:0.0:1789136179.020362:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:2.0:1789136179.020576:0:23390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567174144 00000100:00100000:2.0:1789136179.020583:0:23390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567174144 00000100:00100000:3.0:1789136179.020670:0:23389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 3 00000100:00100000:3.0:1789136179.020681:0:23389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a07ad992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d8be90b6-0a63-4a05-9b5e-0fab1488262f+6:18323:x1876044567174144:12345-192.168.206.56@tcp:900:mount.lustre.0 00000100:00100000:3.0:1789136179.020732:0:23389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a07ad992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d8be90b6-0a63-4a05-9b5e-0fab1488262f+6:18323:x1876044567174144:12345-192.168.206.56@tcp:900:mount.lustre.0 Request processed in 49us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136179.020861:0:23389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 3 00000100:00100000:0.0:1789136179.028468:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:2.0:1789136179.028924:0:23381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567174272 00000100:00100000:2.0:1789136179.028934:0:23381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567174272 00000100:00100000:2.0:1789136179.029002:0:23381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 0 00000100:00100000:2.0:1789136179.029013:0:23381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a07ad9ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d8be90b6-0a63-4a05-9b5e-0fab1488262f+6:18323:x1876044567174272:12345-192.168.206.56@tcp:33:mount.lustre.0 00000004:00080000:2.0:1789136179.031753:0:23381:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2640us 00000004:00200000:0.0:1789136179.057421:0:23381:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1789136179.057542:0:23381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a07ad9ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d8be90b6-0a63-4a05-9b5e-0fab1488262f+6:18323:x1876044567174272:12345-192.168.206.56@tcp:33:mount.lustre.0 Request processed in 28525us (29078us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136179.057557:0:23381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 0 00000100:00100000:0.0:1789136179.289525:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:2.0:1789136179.289607:0:23379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567174400 00000100:00100000:2.0:1789136179.289616:0:23379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567174400 00000100:00100000:2.0:1789136179.289700:0:23379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 13 00000100:00100000:2.0:1789136179.289710:0:23379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a07ad9b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8be90b6-0a63-4a05-9b5e-0fab1488262f+6:18372:x1876044567174400:12345-192.168.206.56@tcp:101:mkdir.0 00010000:00010000:2.0:1789136179.289729:0:23379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789136179.289752:0:23379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94a040031000/0xedd53ca6b6e4763a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19d4d74b7ccf493f expref: -99 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136179.289819:0:23379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94a040031a00/0xedd53ca6b6e47641 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136179.289835:0:23379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94a040031a00/0xedd53ca6b6e47641 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136179.289850:0:23379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94a040031a00/0xedd53ca6b6e47641 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789136179.289909:0:23379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789136179.289913:0:23379:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789136179.289948:0:23379:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94a040031a00/0xedd53ca6b6e47641 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136179.289986:0:23379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94a040031000/0xedd53ca6b6e4763a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf493f expref: 8 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136179.290017:0:23379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94a040031a00/0xedd53ca6b6e47641 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf493f expref: 7 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136179.290025:0:23379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94a0490df400) 00010000:00010000:2.0:1789136179.290028:0:23379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789136179.290031:0:23379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94a040031a00, rc 0) 00000100:00100000:2.0:1789136179.290100:0:23379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a07ad9b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8be90b6-0a63-4a05-9b5e-0fab1488262f+7:18372:x1876044567174400:12345-192.168.206.56@tcp:101:mkdir.0 Request processed in 392us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136179.290117:0:23379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 13 00010000:00010000:1.0:1789136179.507035:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136180.532092:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136181.232970:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4416e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876044587222656:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789136181.233037:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136181.233175:0:24896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587222656 00000100:00100000:2.0:1789136181.233215:0:24896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587222656 00000100:00100000:2.0:1789136181.242324:0:24896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789136181.242349:0:24896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0622e8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876044587222656:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789136181.242382:0:24896:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915845632 avail 3684323328 00000100:00100000:2.0:1789136181.242464:0:24896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0622e8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876044587222656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 127us (9426us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136181.242471:0:24896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1789136181.242499:0:23374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789136181.242513:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a076a2d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876044587222912:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789136181.242620:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07ad98780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876044587222784:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789136181.242709:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4416e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876044587222656:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789136181.246112:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136181.246419:0:23384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587222912 00000100:00100000:1.0:1789136181.246428:0:23384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587222912 00000100:00100000:1.0:1789136181.246506:0:23384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789136181.246515:0:23384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f4402f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876044587222912:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789136181.246546:0:23384:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789136181.246603:0:23384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f4402f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876044587222912:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136181.246610:0:23384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789136181.246698:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a076a2d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876044587222912:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789136181.250343:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136181.250825:0:24123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587222784 00000100:00100000:3.0:1789136181.250834:0:24123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587222784 00000100:00100000:3.0:1789136181.250885:0:24123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789136181.250894:0:24123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a076a2f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876044587222784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789136181.250949:0:24123:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1789136181.251012:0:24123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a076a2f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876044587222784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 118us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136181.251019:0:24123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789136181.251150:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07ad98780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876044587222784:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789136181.285587:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:2.0:1789136181.285821:0:24752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567174528 00000100:00100000:2.0:1789136181.285829:0:24752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567174528 00000100:00100000:2.0:1789136181.285948:0:24752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 14 00000100:00100000:2.0:1789136181.285959:0:24752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a076a2cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8be90b6-0a63-4a05-9b5e-0fab1488262f+7:18424:x1876044567174528:12345-192.168.206.56@tcp:41:lfs.0 00000004:00000024:2.0:1789136181.285988:0:24752:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789136181.286352:0:24752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a076a2cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8be90b6-0a63-4a05-9b5e-0fab1488262f+7:18424:x1876044567174528:12345-192.168.206.56@tcp:41:lfs.0 Request processed in 394us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136181.286361:0:24752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 14 00000100:00100000:3.0:1789136181.288424:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00080000:0.0:1789136181.288600:0:23374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789136181.288653:0:23378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567174656 00000100:00100000:2.0:1789136181.288661:0:23378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567174656 00000100:00100000:2.0:1789136181.288800:0:23378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 15 00000100:00100000:2.0:1789136181.288810:0:23378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0622e9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8be90b6-0a63-4a05-9b5e-0fab1488262f+6:18424:x1876044567174656:12345-192.168.206.56@tcp:41:lfs.0 00000004:00000024:2.0:1789136181.288842:0:23378:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789136181.288946:0:23378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0622e9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8be90b6-0a63-4a05-9b5e-0fab1488262f+6:18424:x1876044567174656:12345-192.168.206.56@tcp:41:lfs.0 Request processed in 137us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136181.288954:0:23378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 15 00000100:00080000:0.0:1789136181.288984:0:23374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789136181.293474:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:2.0:1789136181.307392:0:24896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567174784 00000100:00100000:2.0:1789136181.307404:0:24896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567174784 00000100:00100000:2.0:1789136181.307489:0:24896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 10 00000100:00100000:2.0:1789136181.307499:0:24896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0622e9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d8be90b6-0a63-4a05-9b5e-0fab1488262f+6:18424:x1876044567174784:12345-192.168.206.56@tcp:13:lfs.0 00002000:00000024:2.0:1789136181.307521:0:24896:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915845632 avail 3684323328 00000100:00100000:2.0:1789136181.307610:0:24896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0622e9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d8be90b6-0a63-4a05-9b5e-0fab1488262f+6:18424:x1876044567174784:12345-192.168.206.56@tcp:13:lfs.0 Request processed in 112us (14143us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136181.307617:0:24896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 10 00000100:00080000:3.0:1789136181.307979:0:23374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789136181.311211:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:2.0:1789136181.311661:0:24896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567174912 00000100:00100000:2.0:1789136181.311671:0:24896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567174912 00000100:00100000:2.0:1789136181.311739:0:24896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 11 00000100:00100000:2.0:1789136181.311749:0:24896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a076a2e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d8be90b6-0a63-4a05-9b5e-0fab1488262f+6:18424:x1876044567174912:12345-192.168.206.56@tcp:13:lfs.0 00002000:00000024:2.0:1789136181.311792:0:24896:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1789136181.311868:0:24896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a076a2e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d8be90b6-0a63-4a05-9b5e-0fab1488262f+6:18424:x1876044567174912:12345-192.168.206.56@tcp:13:lfs.0 Request processed in 121us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136181.311877:0:24896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 11 00000100:00080000:3.0:1789136181.311944:0:23374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789136181.544970:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:3.0:1789136181.545076:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567175040 00000100:00100000:3.0:1789136181.545093:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567175040 00000100:00100000:3.0:1789136181.545151:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 131 00000100:00100000:3.0:1789136181.545161:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a081999450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbab00a5-62cb-4304-af69-c2de8be80f81+10:18458:x1876044567175040:12345-192.168.206.56@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789136181.545187:0:23372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789136181.545204:0:23372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94a07a32c800/0xedd53ca6b6e47648 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x19d4d74b7ccf4946 expref: -99 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136181.545232:0:23372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94a07a32c800/0xedd53ca6b6e47648 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4946 expref: 11 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136181.545243:0:23372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94a07a32c800/0xedd53ca6b6e47648 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4946 expref: 11 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136181.545253:0:23372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94a07a32c800, rc 0) 00000100:00100000:3.0:1789136181.545312:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a081999450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbab00a5-62cb-4304-af69-c2de8be80f81+11:18458:x1876044567175040:12345-192.168.206.56@tcp:101:mount.lustre.0 Request processed in 153us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136181.545319:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 131 00010000:00010000:1.0:1789136181.552875:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789136181.560294:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:1.0:1789136181.560456:0:23371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567175168 00000100:00100000:1.0:1789136181.560466:0:23371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567175168 00000100:00100000:1.0:1789136181.560523:0:23371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 132 00000100:00100000:1.0:1789136181.560533:0:23371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a08199a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbab00a5-62cb-4304-af69-c2de8be80f81+11:18458:x1876044567175168:12345-192.168.206.56@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789136181.560746:0:23371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a08199a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbab00a5-62cb-4304-af69-c2de8be80f81+11:18458:x1876044567175168:12345-192.168.206.56@tcp:501:mount.lustre.0 Request processed in 214us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136181.560754:0:23371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 132 00000100:00100000:1.0:1789136181.573299:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:2.0:1789136181.573560:0:23373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567175296 00000100:00100000:2.0:1789136181.573575:0:23373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567175296 00000100:00100000:2.0:1789136181.573671:0:23373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 133 00000100:00100000:2.0:1789136181.573683:0:23373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a08199b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbab00a5-62cb-4304-af69-c2de8be80f81+11:18458:x1876044567175296:12345-192.168.206.56@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789136181.573834:0:23373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a08199b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbab00a5-62cb-4304-af69-c2de8be80f81+11:18458:x1876044567175296:12345-192.168.206.56@tcp:503:mount.lustre.0 Request processed in 154us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136181.573843:0:23373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 133 00000100:00100000:2.0:1789136181.585736:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:3.0:1789136181.585847:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567175424 00000100:00100000:3.0:1789136181.585856:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567175424 00000100:00100000:3.0:1789136181.585908:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 134 00000100:00100000:3.0:1789136181.585919:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a08199b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbab00a5-62cb-4304-af69-c2de8be80f81+11:18464:x1876044567175424:12345-192.168.206.56@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789136181.586067:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a08199b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbab00a5-62cb-4304-af69-c2de8be80f81+11:18464:x1876044567175424:12345-192.168.206.56@tcp:502:llog_process_th.0 Request processed in 150us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136181.586089:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 134 00000100:00100000:0.0:1789136181.625596:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:2.0:1789136181.626123:0:23371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567175552 00000100:00100000:2.0:1789136181.626132:0:23371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567175552 00000100:00100000:2.0:1789136181.626250:0:23371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 135 00000100:00100000:2.0:1789136181.626261:0:23371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a081998050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbab00a5-62cb-4304-af69-c2de8be80f81+11:18464:x1876044567175552:12345-192.168.206.56@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789136181.626423:0:23371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a081998050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbab00a5-62cb-4304-af69-c2de8be80f81+11:18464:x1876044567175552:12345-192.168.206.56@tcp:502:llog_process_th.0 Request processed in 163us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136181.626432:0:23371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 135 00000100:00100000:1.0:1789136181.631205:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:3.0:1789136181.631694:0:23373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567175680 00000100:00100000:3.0:1789136181.631704:0:23373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567175680 00000100:00100000:3.0:1789136181.631772:0:23373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 136 00000100:00100000:3.0:1789136181.631781:0:23373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a076bd1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbab00a5-62cb-4304-af69-c2de8be80f81+11:18464:x1876044567175680:12345-192.168.206.56@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789136181.631912:0:23373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a076bd1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbab00a5-62cb-4304-af69-c2de8be80f81+11:18464:x1876044567175680:12345-192.168.206.56@tcp:502:llog_process_th.0 Request processed in 132us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136181.631920:0:23373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 136 00000100:00100000:1.0:1789136181.640978:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:3.0:1789136181.645560:0:23373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567175808 00000100:00100000:3.0:1789136181.645574:0:23373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567175808 00000100:00100000:3.0:1789136181.645660:0:23373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 137 00000100:00100000:3.0:1789136181.645671:0:23373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a076bd3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbab00a5-62cb-4304-af69-c2de8be80f81+11:18458:x1876044567175808:12345-192.168.206.56@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789136181.645686:0:23373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789136181.645703:0:23373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94a07a32cc00/0xedd53ca6b6e4764f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x19d4d74b7ccf4977 expref: -99 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136181.645729:0:23373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94a07a32cc00/0xedd53ca6b6e4764f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4977 expref: 12 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136181.645740:0:23373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94a07a32cc00/0xedd53ca6b6e4764f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4977 expref: 12 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136181.645748:0:23373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94a07a32cc00, rc 0) 00000100:00100000:3.0:1789136181.645812:0:23373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a076bd3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbab00a5-62cb-4304-af69-c2de8be80f81+12:18458:x1876044567175808:12345-192.168.206.56@tcp:101:mount.lustre.0 Request processed in 143us (4843us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136181.645819:0:23373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 137 00000100:00100000:1.0:1789136181.649713:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:2.0:1789136181.651027:0:23371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567175936 00000100:00100000:2.0:1789136181.651040:0:23371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567175936 00000100:00100000:2.0:1789136181.651106:0:23371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 138 00000100:00100000:2.0:1789136181.651117:0:23371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a076bd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbab00a5-62cb-4304-af69-c2de8be80f81+12:18458:x1876044567175936:12345-192.168.206.56@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789136181.651140:0:23371:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789136181.651166:0:23371:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789136181.651170:0:23371:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789136181.651173:0:23371:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789136181.651187:0:23371:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1789136181.651189:0:23371:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:2.0:1789136181.652904:0:23371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a076bd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbab00a5-62cb-4304-af69-c2de8be80f81+12:18458:x1876044567175936:12345-192.168.206.56@tcp:256:mount.lustre.0 Request processed in 1780us (3191us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136181.652917:0:23371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 138 00000100:00100000:1.0:1789136181.662533:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:0.0:1789136181.662653:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567176064 00000100:00100000:0.0:1789136181.662662:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567176064 00000100:00100000:0.0:1789136181.662758:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 139 00000100:00100000:0.0:1789136181.662768:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a076bd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbab00a5-62cb-4304-af69-c2de8be80f81+12:18458:x1876044567176064:12345-192.168.206.56@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789136181.662783:0:23372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136181.662811:0:23372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff949f43a18200/0xedd53ca6b6e47656 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x19d4d74b7ccf497e expref: -99 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136181.662838:0:23372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff949f43a18200/0xedd53ca6b6e47656 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf497e expref: 13 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136181.662849:0:23372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff949f43a18200/0xedd53ca6b6e47656 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf497e expref: 13 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136181.662858:0:23372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff949f43a18200, rc 0) 00000100:00100000:0.0:1789136181.662913:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a076bd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbab00a5-62cb-4304-af69-c2de8be80f81+13:18458:x1876044567176064:12345-192.168.206.56@tcp:101:mount.lustre.0 Request processed in 147us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136181.662920:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 139 00000100:00100000:1.0:1789136181.667577:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:2.0:1789136181.667662:0:23371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567176192 00000100:00100000:2.0:1789136181.667671:0:23371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567176192 00000100:00100000:2.0:1789136181.667725:0:23371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 140 00000100:00100000:2.0:1789136181.667734:0:23371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a076bd1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbab00a5-62cb-4304-af69-c2de8be80f81+13:18458:x1876044567176192:12345-192.168.206.56@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789136181.667909:0:23371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a076bd1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbab00a5-62cb-4304-af69-c2de8be80f81+13:18458:x1876044567176192:12345-192.168.206.56@tcp:501:mount.lustre.0 Request processed in 175us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136181.667918:0:23371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 140 00000100:00100000:1.0:1789136181.674677:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:0.0:1789136181.674767:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567176320 00000100:00100000:0.0:1789136181.674776:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567176320 00000100:00100000:0.0:1789136181.674872:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 141 00000100:00100000:0.0:1789136181.674883:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a076bd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbab00a5-62cb-4304-af69-c2de8be80f81+13:18458:x1876044567176320:12345-192.168.206.56@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789136181.675103:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a076bd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbab00a5-62cb-4304-af69-c2de8be80f81+13:18458:x1876044567176320:12345-192.168.206.56@tcp:503:mount.lustre.0 Request processed in 221us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136181.675111:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 141 00000100:00100000:1.0:1789136181.681201:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:2.0:1789136181.692927:0:23371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567176448 00000100:00100000:2.0:1789136181.692942:0:23371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567176448 00000100:00100000:2.0:1789136181.693015:0:23371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 142 00000100:00100000:2.0:1789136181.693026:0:23371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a076bd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbab00a5-62cb-4304-af69-c2de8be80f81+13:18467:x1876044567176448:12345-192.168.206.56@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789136181.693201:0:23371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a076bd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbab00a5-62cb-4304-af69-c2de8be80f81+13:18467:x1876044567176448:12345-192.168.206.56@tcp:502:llog_process_th.0 Request processed in 177us (12008us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136181.693210:0:23371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 142 00000100:00100000:1.0:1789136181.701349:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:2.0:1789136181.701452:0:23371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567176576 00000100:00100000:2.0:1789136181.701460:0:23371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567176576 00000100:00100000:2.0:1789136181.701579:0:23371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 143 00000100:00100000:2.0:1789136181.701590:0:23371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a076bd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbab00a5-62cb-4304-af69-c2de8be80f81+13:18467:x1876044567176576:12345-192.168.206.56@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789136181.701764:0:23371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a076bd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbab00a5-62cb-4304-af69-c2de8be80f81+13:18467:x1876044567176576:12345-192.168.206.56@tcp:502:llog_process_th.0 Request processed in 176us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136181.701772:0:23371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 143 00000100:00100000:3.0:1789136181.705489:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:3.0:1789136181.705532:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:1.0:1789136181.705584:0:23380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567176704 00000100:00100000:1.0:1789136181.705597:0:23380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567176704 00000100:00100000:1.0:1789136181.705666:0:23380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567176960 00000100:00100000:1.0:1789136181.705669:0:23380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567176960 00000100:00100000:1.0:1789136181.705698:0:23380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 16 00000100:00100000:1.0:1789136181.705707:0:23380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0622e8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2394:x1876044567176704:12345-192.168.206.56@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789136181.705737:0:23380:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 1bed3215-c3a6-4f6f-b765-010543ef4acb@192.168.206.56@tcp t0 exp 0000000000000000 cur 719 last 0 00000020:00000080:1.0:1789136181.705777:0:23380:0:(genops.c:1385:class_connect()) connect: client 1bed3215-c3a6-4f6f-b765-010543ef4acb, cookie 0xedd53ca6b6e4765d 00000004:00100000:1.0:1789136181.705801:0:23380:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789136181.705895:0:23380:0:(import.c:65:import_set_state_nolock()) ffff949f4509b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789136181.705969:0:23380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0622e8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1bed3215-c3a6-4f6f-b765-010543ef4acb+6:2394:x1876044567176704:12345-192.168.206.56@tcp:38:mount.lustre.0 Request processed in 260us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136181.706010:0:23380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 16 00000100:00100000:3.0:1789136181.706031:0:23379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 17 00000100:00100000:3.0:1789136181.706045:0:23379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a07f6ead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2394:x1876044567176960:12345-192.168.206.56@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789136181.706092:0:23379:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from 1bed3215-c3a6-4f6f-b765-010543ef4acb@192.168.206.56@tcp t0 exp 0000000000000000 cur 719 last 0 00000020:00000080:3.0:1789136181.706134:0:23379:0:(genops.c:1385:class_connect()) connect: client 1bed3215-c3a6-4f6f-b765-010543ef4acb, cookie 0xedd53ca6b6e47664 00000004:00100000:3.0:1789136181.706160:0:23379:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00100000:1.0:1789136181.706330:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:1.0:1789136181.706450:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:1.0:1789136181.706471:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:1.0:1789136181.706488:0:23378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567177472 00000100:00100000:1.0:1789136181.706492:0:23378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567177472 00000100:00100000:1.0:1789136181.706516:0:23378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567177344 00000100:00100000:1.0:1789136181.706519:0:23378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567177344 00000100:00100000:1.0:1789136181.706533:0:23378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 38 00000100:00100000:1.0:1789136181.706541:0:23378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a076a2fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8be90b6-0a63-4a05-9b5e-0fab1488262f+6:2397:x1876044567177472:12345-192.168.206.56@tcp:400:kworker.0 00000100:00100000:1.0:1789136181.706583:0:23378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a076a2fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8be90b6-0a63-4a05-9b5e-0fab1488262f+6:2397:x1876044567177472:12345-192.168.206.56@tcp:400:kworker.0 Request processed in 43us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136181.706590:0:23378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 38 00000100:00100000:1.0:1789136181.706604:0:23378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 39 00000100:00100000:1.0:1789136181.706610:0:23378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a076a2d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8be90b6-0a63-4a05-9b5e-0fab1488262f+7:2397:x1876044567177344:12345-192.168.206.56@tcp:400:kworker.0 00000100:00100000:1.0:1789136181.706655:0:23378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a076a2d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8be90b6-0a63-4a05-9b5e-0fab1488262f+7:2397:x1876044567177344:12345-192.168.206.56@tcp:400:kworker.0 Request processed in 45us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136181.706662:0:23378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 39 00000100:00100000:1.0:1789136181.706708:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:0.0:1789136181.706843:0:25792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567177728 00000100:00100000:0.0:1789136181.706854:0:25792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567177728 00000100:00100000:0.0:1789136181.706889:0:25792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567177600 00000100:00100000:0.0:1789136181.706891:0:25792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567177600 00000100:00100000:0.0:1789136181.706914:0:25792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 3 00000100:00100000:0.0:1789136181.706921:0:25792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a076a2cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d8be90b6-0a63-4a05-9b5e-0fab1488262f+6:2397:x1876044567177728:12345-192.168.206.56@tcp:400:kworker.0 00000100:00100000:0.0:1789136181.706956:0:25792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a076a2cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d8be90b6-0a63-4a05-9b5e-0fab1488262f+6:2397:x1876044567177728:12345-192.168.206.56@tcp:400:kworker.0 Request processed in 36us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136181.706963:0:25792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 3 00000100:00100000:0.0:1789136181.706976:0:25792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 4 00000100:00100000:0.0:1789136181.706997:0:25792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a07ad98780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d8be90b6-0a63-4a05-9b5e-0fab1488262f+6:2397:x1876044567177600:12345-192.168.206.56@tcp:400:kworker.0 00000100:00100000:0.0:1789136181.707022:0:25792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a07ad98780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d8be90b6-0a63-4a05-9b5e-0fab1488262f+6:2397:x1876044567177600:12345-192.168.206.56@tcp:400:kworker.0 Request processed in 40us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136181.707028:0:25792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 4 00000100:00080000:3.0:1789136181.708676:0:23379:0:(import.c:65:import_set_state_nolock()) ffff94a0600ec800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789136181.708782:0:23379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a07f6ead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1bed3215-c3a6-4f6f-b765-010543ef4acb+6:2394:x1876044567176960:12345-192.168.206.56@tcp:38:mount.lustre.0 Request processed in 2738us (3247us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136181.708794:0:23379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 17 00000100:00100000:0.0:1789136181.744699:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:3.0:1789136181.746689:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07f6e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876044587223040:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789136181.746795:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136181.747122:0:23378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567177216 00000100:00100000:1.0:1789136181.747134:0:23378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567177216 00000100:00080000:3.0:1789136181.747423:0:23374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789136181.747432:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f442692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876044587223168:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789136181.747502:0:23378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 18 00000100:00100000:2.0:1789136181.747511:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136181.747519:0:23378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f4402d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1bed3215-c3a6-4f6f-b765-010543ef4acb+6:18458:x1876044567177216:12345-192.168.206.56@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789136181.747563:0:23378:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789136181.747672:0:23378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f4402d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1bed3215-c3a6-4f6f-b765-010543ef4acb+6:18458:x1876044567177216:12345-192.168.206.56@tcp:41:mount.lustre.0 Request processed in 160us (2982us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136181.747700:0:23378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 18 00000100:00100000:1.0:1789136181.747734:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4416e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876044587223296:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789136181.758169:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f442683c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876044587223552:0@lo:400:kworker.0 00000100:00100000:0.0:1789136181.758270:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136181.758361:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789136181.758368:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f44268f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876044587223680:0@lo:400:kworker.0 00000100:00100000:0.0:1789136181.758399:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136181.758431:0:24752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587223680 00000100:00100000:0.0:1789136181.758439:0:24752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587223680 00000100:00100000:0.0:1789136181.758493:0:24752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789136181.758503:0:24752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f44268000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876044587223680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136181.758562:0:24752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f44268000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876044587223680:12345-0@lo:400:kworker.0 Request processed in 59us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136181.758571:0:24752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789136181.758731:0:25476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587223552 00000100:00100000:1.0:1789136181.758737:0:25476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587223552 00000100:00100000:1.0:1789136181.758782:0:25476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789136181.758790:0:25476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f4426b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1876044587223552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136181.758922:0:25476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f4426b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1876044587223552:12345-0@lo:400:kworker.0 Request processed in 133us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136181.758929:0:25476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1789136181.758949:0:23374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789136181.759069:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:1.0:1789136181.759093:0:23378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567177088 00000100:00100000:1.0:1789136181.759098:0:23378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567177088 00000100:00100000:1.0:1789136181.759134:0:23378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 19 00000100:00100000:1.0:1789136181.759141:0:23378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a055722580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1bed3215-c3a6-4f6f-b765-010543ef4acb+6:0:x1876044567177088:12345-192.168.206.56@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789136181.759167:0:23378:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789136181.759243:0:23378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a055722580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1bed3215-c3a6-4f6f-b765-010543ef4acb+6:0:x1876044567177088:12345-192.168.206.56@tcp:41:mount.lustre.0 Request processed in 102us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136181.759250:0:23378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 19 00000100:00080000:1.0:1789136181.759267:0:23374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789136181.759299:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:1.0:1789136181.759345:0:24752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567176832 00000100:00100000:1.0:1789136181.759348:0:24752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567176832 00000100:00100000:1.0:1789136181.759368:0:24752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 20 00000100:00100000:1.0:1789136181.759374:0:24752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a055720780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1bed3215-c3a6-4f6f-b765-010543ef4acb+6:0:x1876044567176832:12345-192.168.206.56@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789136181.759397:0:24752:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789136181.759429:0:24752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a055720780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1bed3215-c3a6-4f6f-b765-010543ef4acb+6:0:x1876044567176832:12345-192.168.206.56@tcp:41:mount.lustre.0 Request processed in 54us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136181.759436:0:24752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 20 00000100:00100000:0.0:1789136181.759827:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f44268f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876044587223680:0@lo:400:kworker.0 00000100:00100000:0.0:1789136181.759921:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:0.0:1789136181.759945:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f442683c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876044587223552:0@lo:400:kworker.0 00000100:00100000:2.0:1789136181.760049:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4426ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3644072c-bb98-4fbe-9eaf-e40d57d161d0:3646:1876044587223424:0@lo:400:kworker.0 00000100:00100000:0.0:1789136181.760130:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f44269680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876044587224064:0@lo:400:kworker.0 00000100:00100000:2.0:1789136181.760132:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136181.760200:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136181.760220:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f44268f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876044587223936:0@lo:400:kworker.0 00000100:00100000:0.0:1789136181.760247:0:23380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587224064 00000100:00100000:0.0:1789136181.760254:0:23380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587224064 00000100:00100000:0.0:1789136181.760295:0:23380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789136181.760302:0:23380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f44269a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876044587224064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136181.760490:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136181.760522:0:23380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f44269a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876044587224064:12345-0@lo:400:kworker.0 Request processed in 221us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136181.760530:0:23380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:0.0:1789136181.760548:0:23374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789136181.760566:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f44269680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876044587224064:0@lo:400:kworker.0 00000100:00100000:0.0:1789136181.760576:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789136181.760583:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a0557212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876044587224192:0@lo:400:kworker.0 00000100:00100000:0.0:1789136181.760605:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136181.760654:0:23378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587224192 00000100:00100000:0.0:1789136181.760659:0:23378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587224192 00000100:00100000:0.0:1789136181.760684:0:23378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789136181.760690:0:23378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f44269680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876044587224192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136181.760722:0:23378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f44269680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876044587224192:12345-0@lo:400:kworker.0 Request processed in 32us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136181.760728:0:23378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:0.0:1789136181.760741:0:23374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1789136181.760758:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94a0557212c0 x1876044587224192/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136197 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136181.760781:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a0557212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876044587224192:0@lo:400:kworker.0 00000100:00100000:2.0:1789136181.761489:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136181.761540:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a0557221c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876044587224448:0@lo:400:kworker.0 00000100:00100000:2.0:1789136181.761577:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136181.761598:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789136181.761606:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f442683c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876044587223808:0@lo:400:kworker.0 00000100:00100000:2.0:1789136181.761647:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136181.761665:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a055723480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876044587224320:0@lo:400:kworker.0 00000100:00100000:2.0:1789136181.761691:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136181.761761:0:23373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587223424 00000100:00100000:2.0:1789136181.761769:0:23373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587223424 00000100:00100000:2.0:1789136181.761814:0:23373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789136181.761823:0:23373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a076bd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3644072c-bb98-4fbe-9eaf-e40d57d161d0+24:3646:x1876044587223424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136181.761871:0:23373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a076bd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3644072c-bb98-4fbe-9eaf-e40d57d161d0+24:3646:x1876044587223424:12345-0@lo:400:kworker.0 Request processed in 49us (1744us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136181.761878:0:23373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789136181.761925:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4426ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3644072c-bb98-4fbe-9eaf-e40d57d161d0:3646:1876044587223424:0@lo:400:kworker.0 00000100:00100000:1.0:1789136181.764298:0:24894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587223808 00000100:00100000:1.0:1789136181.764319:0:24894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587223808 00000100:00100000:2.0:1789136181.764431:0:23380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587223936 00000100:00100000:2.0:1789136181.764444:0:23380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587223936 00000100:00100000:1.0:1789136181.764487:0:24894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789136181.764502:0:24894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f42b1fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876044587223808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136181.764518:0:23380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587224448 00000100:00100000:2.0:1789136181.764524:0:23380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587224448 00000100:00100000:2.0:1789136181.764555:0:23380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587224320 00000100:00100000:2.0:1789136181.764559:0:23380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587224320 00000100:00100000:2.0:1789136181.764586:0:23380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789136181.764599:0:23380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a043739a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876044587223936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136181.764617:0:24894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f42b1fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876044587223808:12345-0@lo:400:kworker.0 Request processed in 118us (2966us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136181.764682:0:24896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587223040 00000100:00100000:3.0:1789136181.764690:0:24896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587223040 00000100:00100000:1.0:1789136181.764731:0:24894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789136181.764739:0:23380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a043739a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876044587223936:12345-0@lo:400:kworker.0 Request processed in 137us (3247us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136181.764750:0:23378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789136181.764764:0:23378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a04373a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876044587224448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136181.764802:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f442683c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876044587223808:0@lo:400:kworker.0 00000100:00100000:3.0:1789136181.764824:0:23378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a04373a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876044587224448:12345-0@lo:400:kworker.0 Request processed in 63us (3244us total) trans 0 rc 0/0 00010000:00080000:1.0:1789136181.764825:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94a0557221c0 x1876044587224448/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136197 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136181.765138:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a0557221c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876044587224448:0@lo:400:kworker.0 00000100:00100000:1.0:1789136181.765161:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f44268f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876044587223936:0@lo:400:kworker.0 00000100:00100000:1.0:1789136181.765221:0:24752:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1789136181.765232:0:24752:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:0.0:1789136181.765450:0:24897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587223168 00000100:00100000:0.0:1789136181.765457:0:24897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587223168 00000100:00100000:0.0:1789136181.765483:0:24897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587223296 00000100:00100000:0.0:1789136181.765486:0:24897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587223296 00000100:00100000:0.0:1789136181.765501:0:24897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789136181.765509:0:24897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f4416e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876044587223168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789136181.765530:0:24897:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1789136181.765582:0:24897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f4416e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876044587223168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (18074us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136181.765589:0:24897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789136181.765603:0:24897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789136181.765609:0:24897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0557203c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876044587223296:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789136181.765620:0:24897:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1789136181.765775:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:1.0:1789136181.765812:0:24752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567177856 00000100:00100000:1.0:1789136181.765816:0:24752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567177856 00000100:00100000:0.0:1789136181.766231:0:24897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0557203c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876044587223296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 620us (5740us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136181.766239:0:24897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789136181.766289:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4416e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876044587223296:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1789136181.766323:0:23374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789136181.766329:0:23374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789136181.766418:0:23374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789136181.766433:0:23379:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1789136181.766531:0:23380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789136181.766574:0:23380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789136181.766588:0:23380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f42b1f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876044587224320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136181.766713:0:23380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f42b1f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876044587224320:12345-0@lo:400:kworker.0 Request processed in 131us (5020us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136181.766721:0:23380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789136181.766779:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a055723480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876044587224320:0@lo:400:kworker.0 00000100:00100000:2.0:1789136181.766847:0:24896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789136181.766853:0:24896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a07f6eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876044587223040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789136181.766869:0:24896:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915845632 avail 3684323328 00000100:00100000:2.0:1789136181.766906:0:24896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a07f6eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876044587223040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (20111us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136181.766912:0:24896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789136181.786374:0:23378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:3.0:1789136181.786442:0:23374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789136181.786492:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f442692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876044587223168:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789136181.786529:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07f6e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876044587223040:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789136181.792557:0:24752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 21 00000100:00100000:1.0:1789136181.792594:0:24752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0557221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1bed3215-c3a6-4f6f-b765-010543ef4acb+6:18458:x1876044567177856:12345-192.168.206.56@tcp:40:mount.lustre.0 00000100:00100000:1.0:1789136181.793131:0:24752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0557221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1bed3215-c3a6-4f6f-b765-010543ef4acb+6:18458:x1876044567177856:12345-192.168.206.56@tcp:40:mount.lustre.0 Request processed in 554us (27355us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136181.793161:0:24752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 21 00000100:00100000:0.0:1789136181.800199:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:0.0:1789136181.800237:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:0.0:1789136181.800273:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:0.0:1789136181.800312:0:25476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567177984 00000100:00100000:0.0:1789136181.800343:0:25476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567177984 00000100:00100000:1.0:1789136181.800356:0:24892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567178112 00000100:00100000:1.0:1789136181.800362:0:24892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567178112 00000100:00100000:2.0:1789136181.800435:0:23390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567178240 00000100:00100000:2.0:1789136181.800439:0:23390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567178240 00000100:00100000:2.0:1789136181.800491:0:23390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 4 00000100:00100000:2.0:1789136181.800513:0:23390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f44269e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:1bed3215-c3a6-4f6f-b765-010543ef4acb+6:18458:x1876044567178240:12345-192.168.206.56@tcp:900:mount.lustre.0 00000100:00100000:2.0:1789136181.800620:0:23390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f44269e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:1bed3215-c3a6-4f6f-b765-010543ef4acb+6:18458:x1876044567178240:12345-192.168.206.56@tcp:900:mount.lustre.0 Request processed in 110us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136181.800653:0:23390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 4 00000100:00100000:0.0:1789136181.800810:0:25476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 18 00000100:00100000:0.0:1789136181.800817:0:25476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f4426b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2394:x1876044567177984:12345-192.168.206.56@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789136181.800850:0:25476:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 1bed3215-c3a6-4f6f-b765-010543ef4acb@192.168.206.56@tcp t0 exp 0000000000000000 cur 719 last 0 00000020:00000080:0.0:1789136181.800893:0:25476:0:(genops.c:1385:class_connect()) connect: client 1bed3215-c3a6-4f6f-b765-010543ef4acb, cookie 0xedd53ca6b6e4766b 00002000:00100000:0.0:1789136181.800909:0:25476:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1bed3215-c3a6-4f6f-b765-010543ef4acb/ffff94a07db87800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113983 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789136181.800923:0:25476:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789136181.801008:0:25476:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789136181.801045:0:25476:0:(import.c:65:import_set_state_nolock()) ffff94a07db80000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789136181.801078:0:25476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f4426b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1bed3215-c3a6-4f6f-b765-010543ef4acb+6:2394:x1876044567177984:12345-192.168.206.56@tcp:8:mount.lustre.0 Request processed in 260us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136181.801085:0:25476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 18 00000100:00100000:0.0:1789136181.801101:0:25476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 19 00000100:00100000:0.0:1789136181.801105:0:25476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f4426a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2394:x1876044567178112:12345-192.168.206.56@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789136181.801122:0:25476:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 1bed3215-c3a6-4f6f-b765-010543ef4acb@192.168.206.56@tcp t0 exp 0000000000000000 cur 719 last 0 00000020:00000080:0.0:1789136181.801138:0:25476:0:(genops.c:1385:class_connect()) connect: client 1bed3215-c3a6-4f6f-b765-010543ef4acb, cookie 0xedd53ca6b6e47672 00002000:00100000:0.0:1789136181.801143:0:25476:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 1bed3215-c3a6-4f6f-b765-010543ef4acb/ffff94a07db85800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113983 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789136181.801150:0:25476:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789136181.801195:0:25476:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789136181.801215:0:25476:0:(import.c:65:import_set_state_nolock()) ffff94a0819f9000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789136181.801238:0:25476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f4426a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1bed3215-c3a6-4f6f-b765-010543ef4acb+6:2394:x1876044567178112:12345-192.168.206.56@tcp:8:mount.lustre.0 Request processed in 131us (964us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136181.801245:0:25476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 19 00000100:00100000:2.0:1789136181.804845:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:3.0:1789136181.805095:0:23382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567178368 00000100:00100000:3.0:1789136181.805107:0:23382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567178368 00000100:00100000:0.0:1789136181.805234:0:23381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 1 00000100:00100000:0.0:1789136181.805265:0:23381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f42b1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1bed3215-c3a6-4f6f-b765-010543ef4acb+6:18458:x1876044567178368:12345-192.168.206.56@tcp:33:mount.lustre.0 00000004:00200000:0.0:1789136181.805386:0:23381:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1789136181.805507:0:23381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f42b1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1bed3215-c3a6-4f6f-b765-010543ef4acb+6:18458:x1876044567178368:12345-192.168.206.56@tcp:33:mount.lustre.0 Request processed in 243us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136181.805520:0:23381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 1 00000100:00100000:0.0:1789136181.958809:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:3.0:1789136181.958912:0:23378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567178496 00000100:00100000:3.0:1789136181.958924:0:23378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567178496 00000100:00100000:3.0:1789136181.959004:0:23378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 22 00000100:00100000:3.0:1789136181.959016:0:23378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f4426b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1bed3215-c3a6-4f6f-b765-010543ef4acb+6:18492:x1876044567178496:12345-192.168.206.56@tcp:101:mkdir.0 00010000:00010000:3.0:1789136181.959070:0:23378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789136181.959111:0:23378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32d000/0xedd53ca6b6e47679 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19d4d74b7ccf49af expref: -99 pid: 23378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136181.959228:0:23378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32d400/0xedd53ca6b6e47680 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136181.959245:0:23378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32d400/0xedd53ca6b6e47680 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136181.959263:0:23378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32d400/0xedd53ca6b6e47680 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789136181.959319:0:23378:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789136181.959323:0:23378:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789136181.959347:0:23378:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32d400/0xedd53ca6b6e47680 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136181.959375:0:23378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32d000/0xedd53ca6b6e47679 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf49af expref: 8 pid: 23378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136181.959396:0:23378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32d400/0xedd53ca6b6e47680 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf49af expref: 7 pid: 23378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136181.959405:0:23378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94a0490df400) 00010000:00010000:3.0:1789136181.959408:0:23378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789136181.959412:0:23378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94a07a32d400, rc 0) 00000100:00100000:3.0:1789136181.959493:0:23378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f4426b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1bed3215-c3a6-4f6f-b765-010543ef4acb+7:18492:x1876044567178496:12345-192.168.206.56@tcp:101:mkdir.0 Request processed in 479us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136181.959502:0:23378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 22 00000040:00080000:1.0:1789136182.129854:0:24136:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789136182.577359:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136183.600862:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136184.624997:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789136184.818791:0:24889:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1bed3215-c3a6-4f6f-b765-010543ef4acb 00000001:00100000:2.0:1789136184.818812:0:24889:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d8be90b6-0a63-4a05-9b5e-0fab1488262f 00000001:00100000:2.0:1789136184.820272:0:25711:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1bed3215-c3a6-4f6f-b765-010543ef4acb 00000001:00100000:2.0:1789136184.820281:0:25711:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d8be90b6-0a63-4a05-9b5e-0fab1488262f 00000001:00100000:2.0:1789136184.820685:0:24115:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 1bed3215-c3a6-4f6f-b765-010543ef4acb 00000001:00100000:2.0:1789136184.820692:0:24115:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of d8be90b6-0a63-4a05-9b5e-0fab1488262f 00000001:00100000:1.0:1789136184.823504:0:23358:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1bed3215-c3a6-4f6f-b765-010543ef4acb 00000001:00100000:1.0:1789136184.823514:0:23358:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d8be90b6-0a63-4a05-9b5e-0fab1488262f 00000001:02000400:0.0:1789136185.129556:0:26272:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1789136185.649516:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136186.353684:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4426bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876044587224576:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789136186.353754:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136186.353798:0:23384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587224576 00000100:00100000:1.0:1789136186.353896:0:23384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587224576 00000100:00100000:1.0:1789136186.354417:0:23384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789136186.354428:0:23384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a07f6eb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876044587224576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789136186.354461:0:23384:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789136186.354516:0:23384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a07f6eb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876044587224576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136186.354525:0:23384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789136186.354604:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4426bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876044587224576:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789136186.354658:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789136186.354666:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f42b1de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876044587224704:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789136186.354710:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136186.354754:0:24896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587224704 00000100:00100000:3.0:1789136186.354759:0:24896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587224704 00000100:00100000:3.0:1789136186.354802:0:24896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789136186.354823:0:24896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a07f6e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876044587224704:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789136186.354846:0:24896:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915845632 avail 3684323328 00000100:00100000:3.0:1789136186.354888:0:24896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a07f6e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876044587224704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136186.354896:0:24896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1789136186.354916:0:23374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789136186.354945:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f42b1de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876044587224704:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789136186.360781:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789136186.360803:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a0557230c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876044587224832:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789136186.360868:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136186.361910:0:23383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587224832 00000100:00100000:1.0:1789136186.361923:0:23383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587224832 00000100:00100000:1.0:1789136186.361984:0:23383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789136186.361993:0:23383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f42b1d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876044587224832:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789136186.362125:0:23383:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789136186.362306:0:23383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f42b1d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876044587224832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 313us (1436us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136186.362314:0:23383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789136186.362901:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a0557230c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876044587224832:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789136186.672887:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789136186.864879:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07f6e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3644072c-bb98-4fbe-9eaf-e40d57d161d0:3647:1876044587225088:0@lo:400:kworker.0 00000100:00100000:3.0:1789136186.864919:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4401de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876044587225344:0@lo:400:kworker.0 00000100:00100000:2.0:1789136186.865017:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07f6e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876044587224960:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789136186.867842:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07f6e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876044587225216:0@lo:400:kworker.0 00000100:00100000:3.0:1789136186.868855:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136186.868900:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4401c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876044587225856:0@lo:400:kworker.0 00000100:00100000:3.0:1789136186.868935:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136186.868965:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f42b1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876044587226368:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789136186.868988:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136186.869396:0:24895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587225344 00000100:00100000:3.0:1789136186.869403:0:24895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587225344 00000100:00100000:3.0:1789136186.869469:0:24895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789136186.869479:0:24895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f4401c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876044587225344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136186.869534:0:24895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f4401c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876044587225344:12345-0@lo:400:kworker.0 Request processed in 57us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136186.869542:0:24895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789136186.869567:0:24752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587225856 00000100:00100000:3.0:1789136186.869570:0:24752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587225856 00000100:00100000:3.0:1789136186.869597:0:24752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789136186.869604:0:24752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f4401f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876044587225856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136186.869663:0:24752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f4401f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876044587225856:12345-0@lo:400:kworker.0 Request processed in 59us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136186.869670:0:24752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789136186.869688:0:24896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587226368 00000100:00100000:3.0:1789136186.869692:0:24896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587226368 00000100:00100000:3.0:1789136186.869714:0:24896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789136186.869720:0:24896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f4401c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876044587226368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789136186.869742:0:24896:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1789136186.870123:0:24896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f4401c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876044587226368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 402us (1133us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136186.870131:0:24896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1789136186.870161:0:23374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789136186.870165:0:23374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789136186.870202:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f42b1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876044587226368:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789136186.870213:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4401de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876044587225344:0@lo:400:kworker.0 00000100:00100000:3.0:1789136186.870222:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4401c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876044587225856:0@lo:400:kworker.0 00000100:00100000:2.0:1789136186.873601:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136186.873660:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4401d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876044587225472:0@lo:400:kworker.0 00000100:00100000:2.0:1789136186.873693:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136186.873715:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4401e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876044587225984:0@lo:400:kworker.0 00000100:00100000:2.0:1789136186.873734:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136186.873820:0:23378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587225472 00000100:00100000:2.0:1789136186.873827:0:23378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587225472 00000100:00100000:2.0:1789136186.873869:0:23378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587225984 00000100:00100000:2.0:1789136186.873884:0:23378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587225984 00000100:00100000:2.0:1789136186.873917:0:23378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789136186.873926:0:23378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f42b1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876044587225472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136186.873971:0:23378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f42b1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876044587225472:12345-0@lo:400:kworker.0 Request processed in 47us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136186.873978:0:23378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789136186.873992:0:23378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789136186.873999:0:23378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f42b1de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876044587225984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136186.874025:0:23378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f42b1de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876044587225984:12345-0@lo:400:kworker.0 Request processed in 27us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136186.874031:0:23378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:2.0:1789136186.874057:0:23374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789136186.874135:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f42b1c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876044587226496:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789136186.874144:0:24896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587224960 00000100:00100000:3.0:1789136186.874159:0:24896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587224960 00000100:00100000:3.0:1789136186.874207:0:24896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789136186.874215:0:24896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f42b1c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876044587224960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789136186.874230:0:24896:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915845632 avail 3684323328 00000100:00100000:3.0:1789136186.874273:0:24896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f42b1c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876044587224960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136186.874288:0:24896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789136186.874440:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136186.874487:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07f6e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876044587224960:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789136186.874498:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4401d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876044587225472:0@lo:400:kworker.0 00010000:00080000:2.0:1789136186.874508:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff949f4401e1c0 x1876044587225984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136202 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789136186.874529:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4401e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876044587225984:0@lo:400:kworker.0 00000100:00080000:2.0:1789136186.874555:0:23374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789136186.876567:0:24896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587226496 00000100:00100000:3.0:1789136186.876582:0:24896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587226496 00000100:00100000:3.0:1789136186.876671:0:24896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789136186.876682:0:24896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0556dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876044587226496:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789136186.876706:0:24896:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1789136186.876781:0:24896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0556dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876044587226496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 101us (2340us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136186.876789:0:24896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1789136186.876925:0:23374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789136186.876968:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f42b1c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876044587226496:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789136186.877116:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136186.877332:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4401cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876044587225600:0@lo:400:kworker.0 00000100:00100000:1.0:1789136186.877369:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136186.877401:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4401ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876044587226112:0@lo:400:kworker.0 00000100:00100000:1.0:1789136186.877427:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136186.877461:0:26186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587226112 00000100:00100000:1.0:1789136186.877466:0:26186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587226112 00000100:00100000:1.0:1789136186.877503:0:26186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789136186.877510:0:26186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a055721680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876044587226112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136186.877570:0:26186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a055721680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876044587226112:12345-0@lo:400:kworker.0 Request processed in 61us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136186.877577:0:26186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789136186.877882:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4401ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876044587226112:0@lo:400:kworker.0 00000100:00100000:3.0:1789136186.878159:0:24892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587225600 00000100:00100000:3.0:1789136186.878165:0:24892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587225600 00000100:00100000:3.0:1789136186.878205:0:24892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789136186.878212:0:24892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a055721a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876044587225600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136186.878259:0:24892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a055721a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876044587225600:12345-0@lo:400:kworker.0 Request processed in 48us (889us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136186.878265:0:24892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789136186.878289:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4401cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876044587225600:0@lo:400:kworker.0 00000100:00100000:0.0:1789136186.878494:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136186.878573:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4401cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876044587225728:0@lo:400:kworker.0 00000100:00100000:0.0:1789136186.878599:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136186.878623:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4401e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1876044587226240:0@lo:400:kworker.0 00000100:00100000:0.0:1789136186.878666:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136186.878841:0:24752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587225728 00000100:00100000:3.0:1789136186.878845:0:24752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587225728 00000100:00100000:3.0:1789136186.878877:0:24752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587226240 00000100:00100000:3.0:1789136186.878880:0:24752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587226240 00000100:00100000:3.0:1789136186.878895:0:24752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789136186.878901:0:24752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f44268b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876044587225728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136186.878940:0:24752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f44268b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876044587225728:12345-0@lo:400:kworker.0 Request processed in 39us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136186.878946:0:24752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789136186.878958:0:24752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789136186.878964:0:24752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f4426a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1876044587226240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136186.878990:0:24752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f4426a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1876044587226240:12345-0@lo:400:kworker.0 Request processed in 27us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136186.878995:0:24752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789136186.879023:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4401cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876044587225728:0@lo:400:kworker.0 00010000:00080000:3.0:1789136186.879033:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff949f4401e940 x1876044587226240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136202 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136186.879042:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4401e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1876044587226240:0@lo:400:kworker.0 00000100:00080000:3.0:1789136186.882898:0:23374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789136186.882908:0:23374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789136186.882983:0:23371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587225088 00000100:00100000:2.0:1789136186.882994:0:23371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587225088 00000100:00100000:2.0:1789136186.883063:0:23371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789136186.883086:0:23371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a076bd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+24:3647:x1876044587225088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136186.883199:0:23371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a076bd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+24:3647:x1876044587225088:12345-0@lo:400:kworker.0 Request processed in 114us (6083us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136186.883207:0:23371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789136186.883271:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07f6e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3644072c-bb98-4fbe-9eaf-e40d57d161d0:3647:1876044587225088:0@lo:400:kworker.0 00000100:00100000:1.0:1789136186.883445:0:24894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587225216 00000100:00100000:1.0:1789136186.883450:0:24894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587225216 00000100:00100000:1.0:1789136186.886277:0:24894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789136186.886298:0:24894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f4426a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876044587225216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136186.886395:0:24894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f4426a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876044587225216:12345-0@lo:400:kworker.0 Request processed in 106us (7900us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136186.886402:0:24894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789136186.886457:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07f6e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876044587225216:0@lo:400:kworker.0 00000100:00100000:2.0:1789136187.114893:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:2.0:1789136187.114932:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:2.0:1789136187.114969:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:2.0:1789136187.114998:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:2.0:1789136187.115025:0:23378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567178752 00000100:00100000:2.0:1789136187.115034:0:23378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567178752 00000100:00100000:2.0:1789136187.115103:0:23378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567179264 00000100:00100000:2.0:1789136187.115106:0:23378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567179264 00000100:00100000:2.0:1789136187.115130:0:23378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 52 00000100:00100000:2.0:1789136187.115140:0:23378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0556dc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8be90b6-0a63-4a05-9b5e-0fab1488262f+6:2397:x1876044567178752:12345-192.168.206.56@tcp:400:kworker.0 00000100:00100000:2.0:1789136187.115220:0:23378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0556dc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8be90b6-0a63-4a05-9b5e-0fab1488262f+6:2397:x1876044567178752:12345-192.168.206.56@tcp:400:kworker.0 Request processed in 81us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136187.115228:0:23378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 52 00000100:00100000:2.0:1789136187.115245:0:23378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 53 00000100:00100000:2.0:1789136187.115252:0:23378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0556df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1bed3215-c3a6-4f6f-b765-010543ef4acb+6:2397:x1876044567179264:12345-192.168.206.56@tcp:400:kworker.0 00000100:00100000:2.0:1789136187.115276:0:23378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0556df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1bed3215-c3a6-4f6f-b765-010543ef4acb+6:2397:x1876044567179264:12345-192.168.206.56@tcp:400:kworker.0 Request processed in 24us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136187.115282:0:23378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 53 00000100:00100000:2.0:1789136187.115300:0:25792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567179008 00000100:00100000:2.0:1789136187.115304:0:25792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567179008 00000100:00100000:2.0:1789136187.115341:0:25792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567179520 00000100:00100000:2.0:1789136187.115344:0:25792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567179520 00000100:00100000:2.0:1789136187.115364:0:25792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 10 00000100:00100000:2.0:1789136187.115372:0:25792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0556dcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d8be90b6-0a63-4a05-9b5e-0fab1488262f+5:2397:x1876044567179008:12345-192.168.206.56@tcp:400:kworker.0 00000100:00100000:2.0:1789136187.115397:0:25792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0556dcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d8be90b6-0a63-4a05-9b5e-0fab1488262f+5:2397:x1876044567179008:12345-192.168.206.56@tcp:400:kworker.0 Request processed in 27us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136187.115403:0:25792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 10 00000100:00100000:2.0:1789136187.115414:0:25792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 11 00000100:00100000:2.0:1789136187.115421:0:25792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0556dfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1bed3215-c3a6-4f6f-b765-010543ef4acb+5:2397:x1876044567179520:12345-192.168.206.56@tcp:400:kworker.0 00000100:00100000:2.0:1789136187.115443:0:25792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0556dfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1bed3215-c3a6-4f6f-b765-010543ef4acb+5:2397:x1876044567179520:12345-192.168.206.56@tcp:400:kworker.0 Request processed in 22us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136187.115450:0:25792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 11 00000100:00080000:2.0:1789136187.115465:0:23374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789136187.115469:0:23374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789136187.134199:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:1.0:1789136187.134244:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:1.0:1789136187.134264:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:1.0:1789136187.134285:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:1.0:1789136187.134309:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:1.0:1789136187.134351:0:24895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567179136 00000100:00100000:1.0:1789136187.134365:0:24895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567179136 00000100:00100000:1.0:1789136187.134417:0:24895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567179648 00000100:00100000:1.0:1789136187.134421:0:24895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567179648 00000100:00100000:1.0:1789136187.134443:0:24895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 12 00000100:00100000:1.0:1789136187.134452:0:24895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a055721e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d8be90b6-0a63-4a05-9b5e-0fab1488262f+5:2397:x1876044567179136:12345-192.168.206.56@tcp:400:kworker.0 00000100:00100000:1.0:1789136187.134519:0:24895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a055721e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d8be90b6-0a63-4a05-9b5e-0fab1488262f+5:2397:x1876044567179136:12345-192.168.206.56@tcp:400:kworker.0 Request processed in 67us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136187.134526:0:24895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 12 00000100:00100000:1.0:1789136187.134541:0:24895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 13 00000100:00100000:1.0:1789136187.134547:0:24895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0557230c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1bed3215-c3a6-4f6f-b765-010543ef4acb+5:2397:x1876044567179648:12345-192.168.206.56@tcp:400:kworker.0 00000100:00100000:1.0:1789136187.134570:0:24895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0557230c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1bed3215-c3a6-4f6f-b765-010543ef4acb+5:2397:x1876044567179648:12345-192.168.206.56@tcp:400:kworker.0 Request processed in 23us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136187.134576:0:24895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 13 00000100:00080000:1.0:1789136187.134596:0:23374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789136187.134609:0:23378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567178880 00000100:00100000:1.0:1789136187.134613:0:23378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567178880 00000100:00100000:1.0:1789136187.134666:0:23378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567179392 00000100:00100000:1.0:1789136187.134669:0:23378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567179392 00000100:00100000:1.0:1789136187.134683:0:23378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 54 00000100:00100000:1.0:1789136187.134688:0:23378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a055720f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8be90b6-0a63-4a05-9b5e-0fab1488262f+5:2397:x1876044567178880:12345-192.168.206.56@tcp:400:kworker.0 00000100:00100000:1.0:1789136187.134711:0:23378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a055720f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8be90b6-0a63-4a05-9b5e-0fab1488262f+5:2397:x1876044567178880:12345-192.168.206.56@tcp:400:kworker.0 Request processed in 23us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136187.134716:0:23378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 54 00000100:00100000:1.0:1789136187.134725:0:23378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 55 00000100:00100000:1.0:1789136187.134730:0:23378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a055720b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1bed3215-c3a6-4f6f-b765-010543ef4acb+5:2397:x1876044567179392:12345-192.168.206.56@tcp:400:kworker.0 00000100:00100000:1.0:1789136187.134749:0:23378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a055720b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1bed3215-c3a6-4f6f-b765-010543ef4acb+5:2397:x1876044567179392:12345-192.168.206.56@tcp:400:kworker.0 Request processed in 18us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136187.134761:0:23378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 55 00000100:00080000:1.0:1789136187.134775:0:23374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789136187.134851:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567178624 00000100:00100000:2.0:1789136187.134855:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567178624 00000100:00100000:2.0:1789136187.134881:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 146 00000100:00100000:2.0:1789136187.134887:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a076bd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbab00a5-62cb-4304-af69-c2de8be80f81+13:2397:x1876044567178624:12345-192.168.206.56@tcp:400:kworker.0 00000100:00100000:2.0:1789136187.134912:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a076bd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbab00a5-62cb-4304-af69-c2de8be80f81+13:2397:x1876044567178624:12345-192.168.206.56@tcp:400:kworker.0 Request processed in 26us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136187.134918:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 146 00010000:00010000:1.0:1789136187.705239:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789136188.084651:0:23417:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000080:3.0:1789136188.603394:0:26419:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff26c9cc40 20000000:00000080:3.0:1789136188.603409:0:26419:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff94a07db77000 uarg=0000000000000000 20000000:01000000:3.0:1789136188.603457:0:26419:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789136188.603462:0:26419:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789136188.603466:0:26419:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1789136188.604278:0:26420:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 19 20000000:00000400:3.0:1789136188.604411:0:26419:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789136188.618518:0:26419:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789136188.618548:0:26419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff94a07a32c200/0xedd53ca6b6e47687 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136188.618582:0:26419:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94a0429a9200/0xedd53ca6b6e472e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedd53ca6b6e472dd expref: 23 pid: 23371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136188.618589:0:26419:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff949f4483cc00/0xedd53ca6b6e472f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedd53ca6b6e472eb expref: 23 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136188.618594:0:26419:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94a0429a9800/0xedd53ca6b6e47331 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedd53ca6b6e4732a expref: 23 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136188.618600:0:26419:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94a07a32c600/0xedd53ca6b6e473cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedd53ca6b6e473c4 expref: 23 pid: 23371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136188.618609:0:26419:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94a07a32ce00/0xedd53ca6b6e47617 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf490e expref: 12 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136188.618615:0:26419:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff949f43a18200/0xedd53ca6b6e47656 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf497e expref: 12 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136188.618623:0:26419:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff94a07a32c200/0xedd53ca6b6e47687 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 26419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136188.618689:0:26419:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff949f43a18200/0xedd53ca6b6e47656 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf497e expref: 12 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136188.618716:0:26419:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff949f43a18200/0xedd53ca6b6e47656 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf497e expref: 12 pid: 23372 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136188.618731:0:26419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4401e940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26419:1876044587226624:192.168.206.56@tcp:104: 00010000:00010000:3.0:1789136188.618817:0:26419:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94a07a32ce00/0xedd53ca6b6e47617 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf490e expref: 12 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136188.618831:0:26419:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94a07a32ce00/0xedd53ca6b6e47617 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf490e expref: 12 pid: 23372 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136188.618839:0:26419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4401cf00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26419:1876044587226752:192.168.206.56@tcp:104: 00010000:00010000:3.0:1789136188.618869:0:26419:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94a07a32c600/0xedd53ca6b6e473cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xedd53ca6b6e473c4 expref: 23 pid: 23371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136188.618878:0:26419:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94a07a32c600/0xedd53ca6b6e473cb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xedd53ca6b6e473c4 expref: 23 pid: 23371 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136188.618887:0:26419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4401cb40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26419:1876044587226880:0@lo:104: 00000100:00100000:3.0:1789136188.618924:0:26419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789136188.618958:0:26419:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94a0429a9800/0xedd53ca6b6e47331 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xedd53ca6b6e4732a expref: 23 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136188.618966:0:26419:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94a0429a9800/0xedd53ca6b6e47331 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xedd53ca6b6e4732a expref: 23 pid: 23372 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136188.618973:0:26419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4401de00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26419:1876044587227008:0@lo:104: 00000100:00100000:0.0:1789136188.618980:0:23361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587226880 00000100:00100000:0.0:1789136188.618986:0:23361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587226880 00000100:00100000:0.0:1789136188.619029:0:23361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789136188.619039:0:23361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f4401c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+3:26419:x1876044587226880:12345-0@lo:104: 00010000:00010000:0.0:1789136188.619062:0:23361:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.156@tcp lock: ffff949f4483da00/0xedd53ca6b6e473c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xedd53ca6b6e473cb expref: -99 pid: 25710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136188.619109:0:23361:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789136188.619114:0:23361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f4401c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+3:26419:x1876044587226880:12345-0@lo:104: Request processed in 78us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136188.619122:0:23361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:0.0:1789136188.619814:0:23367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789136188.619832:0:23367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.156@tcp lock: ffff949f4483da00/0xedd53ca6b6e473c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xedd53ca6b6e473cb expref: -99 pid: 25710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136188.619841:0:23367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff949f4483da00 already unused, calling callback (ffffffffc13c2c20) 10000000:00010000:0.0:1789136188.619845:0:23367:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.156@tcp lock: ffff949f4483da00/0xedd53ca6b6e473c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xedd53ca6b6e473cb expref: -99 pid: 25710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136188.619854:0:23367:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.156@tcp lock: ffff949f4483da00/0xedd53ca6b6e473c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xedd53ca6b6e473cb expref: -99 pid: 25710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789136188.619861:0:23367:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.156@tcp lock: ffff949f4483da00/0xedd53ca6b6e473c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xedd53ca6b6e473cb expref: -99 pid: 25710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789136188.619866:0:23367:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789136188.619898:0:23367:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.156@tcp lock: ffff949f4483da00/0xedd53ca6b6e473c4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedd53ca6b6e473cb expref: -99 pid: 25710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136188.619904:0:23367:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789136188.619925:0:23367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.156@tcp lock: ffff949f4483da00/0xedd53ca6b6e473c4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedd53ca6b6e473cb expref: -99 pid: 25710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136188.619931:0:23367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.156@tcp lock: ffff949f4483da00/0xedd53ca6b6e473c4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedd53ca6b6e473cb expref: -99 pid: 25710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136188.619943:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136188.619945:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136188.619947:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789136188.619960:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f44268780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3644072c-bb98-4fbe-9eaf-e40d57d161d0:3647:1876044587227136:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789136188.620000:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136188.620050:0:23365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587227136 00000100:00100000:0.0:1789136188.620060:0:23365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587227136 00010000:00010000:0.0:1789136188.620081:0:23365:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94a07a32c600/0xedd53ca6b6e473cb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedd53ca6b6e473c4 expref: 24 pid: 23371 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136188.620106:0:23365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789136188.620113:0:23365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f4426bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3644072c-bb98-4fbe-9eaf-e40d57d161d0+24:3647:x1876044587227136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789136188.620123:0:23365:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789136188.620128:0:23365:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94a07a32c600/0xedd53ca6b6e473cb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedd53ca6b6e473c4 expref: 24 pid: 23371 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136188.620149:0:23365:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94a07a32c600/0xedd53ca6b6e473cb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xedd53ca6b6e473c4 expref: 24 pid: 23371 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136188.620164:0:23365:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789136188.620193:0:23365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f4426bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3644072c-bb98-4fbe-9eaf-e40d57d161d0+24:3647:x1876044587227136:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136188.620199:0:23365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789136188.620231:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f44268780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3644072c-bb98-4fbe-9eaf-e40d57d161d0:3647:1876044587227136:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789136188.621311:0:26419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789136188.621362:0:26419:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff949f4483cc00/0xedd53ca6b6e472f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xedd53ca6b6e472eb expref: 23 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136188.621375:0:26419:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff949f4483cc00/0xedd53ca6b6e472f2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xedd53ca6b6e472eb expref: 23 pid: 23373 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136188.621387:0:26419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4401e580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26419:1876044587227264:0@lo:104: 00000100:00100000:3.0:1789136188.621411:0:26419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136188.621454:0:23361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587227008 00000100:00100000:0.0:1789136188.621461:0:23361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587227008 00000100:00100000:0.0:1789136188.621487:0:23361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587227264 00000100:00100000:0.0:1789136188.621490:0:23361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587227264 00000100:00100000:0.0:1789136188.621502:0:23361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789136188.621509:0:23361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f4401f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+4:26419:x1876044587227008:12345-0@lo:104: 00010000:00010000:0.0:1789136188.621520:0:23361:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.156@tcp lock: ffff94a07a32d200/0xedd53ca6b6e4732a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xedd53ca6b6e47331 expref: -99 pid: 24888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136188.621568:0:23361:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1789136188.621569:0:26419:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94a0429a9200/0xedd53ca6b6e472e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xedd53ca6b6e472dd expref: 23 pid: 23371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136188.621573:0:23361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f4401f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+4:26419:x1876044587227008:12345-0@lo:104: Request processed in 65us (266us total) trans 0 rc 0/0 00010000:00010000:2.0:1789136188.621578:0:26419:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94a0429a9200/0xedd53ca6b6e472e4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xedd53ca6b6e472dd expref: 23 pid: 23371 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136188.621586:0:23361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789136188.621596:0:26419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a0556dcb40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26419:1876044587227392:0@lo:104: 00000100:00100000:0.0:1789136188.621600:0:23361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789136188.621605:0:23361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f4401da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+3:26419:x1876044587227264:12345-0@lo:104: 00010000:00010000:0.0:1789136188.621612:0:23361:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.156@tcp lock: ffff94a0413fce00/0xedd53ca6b6e472eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xedd53ca6b6e472f2 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136188.621620:0:26419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136188.621661:0:26419:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a045446480 going to sleep for 11 seconds 00010000:00010000:0.0:1789136188.621661:0:23361:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789136188.621666:0:23361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f4401da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+3:26419:x1876044587227264:12345-0@lo:104: Request processed in 62us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136188.621672:0:23361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1789136188.621678:0:26419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94a07a32c600/0xedd53ca6b6e473cb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xedd53ca6b6e473c4 expref: 23 pid: 23371 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136188.621681:0:23361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587227392 00000100:00100000:0.0:1789136188.621684:0:23361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587227392 00000100:00100000:2.0:1789136188.621690:0:26419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4401cb40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26419:1876044587226880:0@lo:104: 00000100:00100000:0.0:1789136188.621696:0:23361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789136188.621698:0:26419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4401de00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26419:1876044587227008:0@lo:104: 00000100:00100000:0.0:1789136188.621701:0:23361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0556dd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+3:26419:x1876044587227392:12345-0@lo:104: 00000100:00100000:2.0:1789136188.621704:0:26419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4401e580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26419:1876044587227264:0@lo:104: 00010000:00010000:0.0:1789136188.621708:0:23361:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.156@tcp lock: ffff94a07a32d600/0xedd53ca6b6e472dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xedd53ca6b6e472e4 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136188.621742:0:23361:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789136188.621747:0:23361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0556dd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+3:26419:x1876044587227392:12345-0@lo:104: Request processed in 47us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136188.621753:0:23361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789136188.621763:0:26419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a0556dcb40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26419:1876044587227392:0@lo:104: 00010000:00010000:0.0:1789136188.621766:0:23367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789136188.621771:0:23367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.156@tcp lock: ffff94a07a32d200/0xedd53ca6b6e4732a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xedd53ca6b6e47331 expref: -99 pid: 24888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136188.621778:0:23367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a07a32d200 already unused, calling callback (ffffffffc13c2c20) 10000000:00010000:0.0:1789136188.621781:0:23367:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.156@tcp lock: ffff94a07a32d200/0xedd53ca6b6e4732a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xedd53ca6b6e47331 expref: -99 pid: 24888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136188.621796:0:23367:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.156@tcp lock: ffff94a07a32d200/0xedd53ca6b6e4732a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xedd53ca6b6e47331 expref: -99 pid: 24888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789136188.621803:0:23367:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.156@tcp lock: ffff94a07a32d200/0xedd53ca6b6e4732a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xedd53ca6b6e47331 expref: -99 pid: 24888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789136188.621808:0:23367:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789136188.621839:0:23367:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.156@tcp lock: ffff94a07a32d200/0xedd53ca6b6e4732a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedd53ca6b6e47331 expref: -99 pid: 24888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136188.621846:0:23367:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789136188.621863:0:23367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.156@tcp lock: ffff94a07a32d200/0xedd53ca6b6e4732a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedd53ca6b6e47331 expref: -99 pid: 24888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136188.621870:0:23367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.156@tcp lock: ffff94a07a32d200/0xedd53ca6b6e4732a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedd53ca6b6e47331 expref: -99 pid: 24888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136188.621880:0:23367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789136188.621883:0:23367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.156@tcp lock: ffff94a0413fce00/0xedd53ca6b6e472eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xedd53ca6b6e472f2 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136188.621888:0:23367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a0413fce00 already unused, calling callback (ffffffffc13c2c20) 10000000:00010000:0.0:1789136188.621891:0:23367:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.156@tcp lock: ffff94a0413fce00/0xedd53ca6b6e472eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xedd53ca6b6e472f2 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136188.621898:0:23367:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.156@tcp lock: ffff94a0413fce00/0xedd53ca6b6e472eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xedd53ca6b6e472f2 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789136188.621903:0:23367:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.156@tcp lock: ffff94a0413fce00/0xedd53ca6b6e472eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xedd53ca6b6e472f2 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789136188.621913:0:23367:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789136188.621927:0:23367:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.156@tcp lock: ffff94a0413fce00/0xedd53ca6b6e472eb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedd53ca6b6e472f2 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136188.621932:0:23367:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789136188.621947:0:23367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.156@tcp lock: ffff94a0413fce00/0xedd53ca6b6e472eb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedd53ca6b6e472f2 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136188.621954:0:23367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.156@tcp lock: ffff94a0413fce00/0xedd53ca6b6e472eb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedd53ca6b6e472f2 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136188.621963:0:23367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789136188.621965:0:23367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.156@tcp lock: ffff94a07a32d600/0xedd53ca6b6e472dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xedd53ca6b6e472e4 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136188.621970:0:23367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a07a32d600 already unused, calling callback (ffffffffc13c2c20) 10000000:00010000:0.0:1789136188.621973:0:23367:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.156@tcp lock: ffff94a07a32d600/0xedd53ca6b6e472dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xedd53ca6b6e472e4 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136188.621979:0:23367:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.156@tcp lock: ffff94a07a32d600/0xedd53ca6b6e472dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xedd53ca6b6e472e4 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789136188.621985:0:23367:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.156@tcp lock: ffff94a07a32d600/0xedd53ca6b6e472dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xedd53ca6b6e472e4 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789136188.621991:0:23367:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789136188.622001:0:23367:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.156@tcp lock: ffff94a07a32d600/0xedd53ca6b6e472dd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedd53ca6b6e472e4 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136188.622006:0:23367:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789136188.622018:0:23367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.156@tcp lock: ffff94a07a32d600/0xedd53ca6b6e472dd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedd53ca6b6e472e4 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136188.622024:0:23367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.156@tcp lock: ffff94a07a32d600/0xedd53ca6b6e472dd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedd53ca6b6e472e4 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136188.622038:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136188.622040:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136188.622041:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136188.622545:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789136188.623400:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f442692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3644072c-bb98-4fbe-9eaf-e40d57d161d0:3645:1876044587227648:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789136188.623433:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f44268780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3644072c-bb98-4fbe-9eaf-e40d57d161d0:3648:1876044587227520:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789136188.623457:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136188.623475:0:23364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587227648 00000100:00100000:1.0:1789136188.623480:0:23364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587227648 00010000:00010000:1.0:1789136188.623509:0:23364:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff949f4483cc00/0xedd53ca6b6e472f2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedd53ca6b6e472eb expref: 23 pid: 23373 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136188.623545:0:23364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789136188.623553:0:23364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f442683c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+23:3645:x1876044587227648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789136188.623566:0:23364:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789136188.623571:0:23364:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff949f4483cc00/0xedd53ca6b6e472f2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedd53ca6b6e472eb expref: 23 pid: 23373 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136188.623581:0:23364:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff949f4483cc00/0xedd53ca6b6e472f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xedd53ca6b6e472eb expref: 23 pid: 23373 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136188.623596:0:23364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff949f4483cc00/0xedd53ca6b6e472f2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xedd53ca6b6e472eb expref: 23 pid: 23373 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136188.623608:0:23364:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789136188.627182:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136188.629212:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789136188.629229:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f44268f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3644072c-bb98-4fbe-9eaf-e40d57d161d0:3645:1876044587227776:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789136188.629271:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136188.629279:0:23364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f442683c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+22:3645:x1876044587227648:12345-0@lo:103:ldlm_bl.0 Request processed in 5726us (5820us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136188.629291:0:23364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789136188.629306:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f442692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3644072c-bb98-4fbe-9eaf-e40d57d161d0:3645:1876044587227648:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789136188.629316:0:23364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587227520 00000100:00100000:1.0:1789136188.629334:0:23364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587227520 00000100:00100000:0.0:1789136188.629355:0:23363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587227776 00000100:00100000:0.0:1789136188.629358:0:23363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587227776 00010000:00010000:1.0:1789136188.629361:0:23364:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94a0429a9800/0xedd53ca6b6e47331 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedd53ca6b6e4732a expref: 22 pid: 23372 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136188.629369:0:23363:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94a0429a9200/0xedd53ca6b6e472e4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedd53ca6b6e472dd expref: 23 pid: 23371 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136188.629517:0:23363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789136188.629526:0:23363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0556de580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+23:3648:x1876044587227520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789136188.629540:0:23363:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789136188.629546:0:23363:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94a0429a9800/0xedd53ca6b6e47331 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedd53ca6b6e4732a expref: 23 pid: 23372 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136188.629555:0:23363:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94a0429a9800/0xedd53ca6b6e47331 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xedd53ca6b6e4732a expref: 23 pid: 23372 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136188.629583:0:23363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94a0429a9800/0xedd53ca6b6e47331 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xedd53ca6b6e4732a expref: 23 pid: 23372 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136188.629596:0:23363:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789136188.629656:0:23363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0556de580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+22:3648:x1876044587227520:12345-0@lo:103:ldlm_bl.0 Request processed in 132us (2480us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136188.629663:0:23363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789136188.629678:0:23363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789136188.629684:0:23363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f4426ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+21:3645:x1876044587227776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789136188.629704:0:23363:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789136188.629708:0:23363:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94a0429a9200/0xedd53ca6b6e472e4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedd53ca6b6e472dd expref: 21 pid: 23371 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136188.629715:0:23363:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94a0429a9200/0xedd53ca6b6e472e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xedd53ca6b6e472dd expref: 21 pid: 23371 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136188.629724:0:23363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94a0429a9200/0xedd53ca6b6e472e4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xedd53ca6b6e472dd expref: 21 pid: 23371 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136188.629732:0:23363:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789136188.629758:0:23363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f4426ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+20:3645:x1876044587227776:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136188.629764:0:23363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789136188.629797:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f44268f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3644072c-bb98-4fbe-9eaf-e40d57d161d0:3645:1876044587227776:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789136188.629876:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f44268780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3644072c-bb98-4fbe-9eaf-e40d57d161d0:3648:1876044587227520:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789136188.630271:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:3.0:1789136188.630306:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:3.0:1789136188.630326:0:23365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567179776 00000100:00100000:3.0:1789136188.630331:0:23365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567179776 00010000:00010000:3.0:1789136188.630354:0:23365:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff949f43a18200/0xedd53ca6b6e47656 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf497e expref: 13 pid: 23372 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136188.630367:0:23365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567179904 00000100:00100000:3.0:1789136188.630370:0:23365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567179904 00010000:00010000:3.0:1789136188.630381:0:23365:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94a07a32ce00/0xedd53ca6b6e47617 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf490e expref: 14 pid: 23372 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136188.630394:0:23365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 13 00000100:00100000:3.0:1789136188.630401:0:23365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a043c6f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbab00a5-62cb-4304-af69-c2de8be80f81+14:2397:x1876044567179776:12345-192.168.206.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789136188.630409:0:23365:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789136188.630414:0:23365:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff949f43a18200/0xedd53ca6b6e47656 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf497e expref: 14 pid: 23372 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136188.630423:0:23365:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff949f43a18200/0xedd53ca6b6e47656 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf497e expref: 14 pid: 23372 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136188.630436:0:23365:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789136188.630471:0:23365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a043c6f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbab00a5-62cb-4304-af69-c2de8be80f81+14:2397:x1876044567179776:12345-192.168.206.56@tcp:103:ldlm_bl.0 Request processed in 72us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136188.630478:0:23365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 13 00000100:00100000:3.0:1789136188.630516:0:23365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 14 00000100:00100000:3.0:1789136188.630523:0:23365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f4401f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbab00a5-62cb-4304-af69-c2de8be80f81+13:2397:x1876044567179904:12345-192.168.206.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789136188.630530:0:23365:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789136188.630542:0:23365:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94a07a32ce00/0xedd53ca6b6e47617 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf490e expref: 13 pid: 23372 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136188.630551:0:23365:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94a07a32ce00/0xedd53ca6b6e47617 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf490e expref: 13 pid: 23372 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136188.630563:0:23365:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff94a07a32c200/0xedd53ca6b6e47687 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 26419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136188.630572:0:23365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94a07a32c200/0xedd53ca6b6e47687 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 26419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136188.630587:0:23365:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94a07a32c200/0xedd53ca6b6e47687 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 26419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136188.630593:0:23365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94a07a32c200/0xedd53ca6b6e47687 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 26419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136188.630600:0:23365:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff94a07a32c200/0xedd53ca6b6e47687 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 26419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136188.630607:0:23365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff94a07a32c200/0xedd53ca6b6e47687 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 26419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136188.630613:0:23365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a07a32c200 already unused, calling callback (ffffffffc0d90550) 00010000:00010000:3.0:1789136188.630616:0:23365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff94a07a32c200/0xedd53ca6b6e47687 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 26419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136188.630624:0:23365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff94a07a32c200/0xedd53ca6b6e47687 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 26419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136188.630659:0:23365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff94a07a32c200/0xedd53ca6b6e47687 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 26419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136188.630675:0:23365:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789136188.630696:0:23365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f4401f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbab00a5-62cb-4304-af69-c2de8be80f81+13:2397:x1876044567179904:12345-192.168.206.56@tcp:103:ldlm_bl.0 Request processed in 172us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136188.630703:0:23365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 14 00010000:00010000:2.0:1789136188.631225:0:26419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff949f43a18200/0xedd53ca6b6e47656 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf497e expref: 12 pid: 23372 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136188.631239:0:26419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4401e940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26419:1876044587226624:192.168.206.56@tcp:104: 00010000:00010000:2.0:1789136188.631250:0:26419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94a07a32ce00/0xedd53ca6b6e47617 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf490e expref: 11 pid: 23372 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136188.631259:0:26419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4401cf00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26419:1876044587226752:192.168.206.56@tcp:104: 00010000:00010000:2.0:1789136188.631285:0:26419:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff94a07a32c200/0xedd53ca6b6e47687 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 26419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136188.631295:0:26419:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff94a07a32c200/0xedd53ca6b6e47687 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 26419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136188.631313:0:26419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff94a07a32c200/0xedd53ca6b6e47687 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 26419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136188.631320:0:26419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94a07a32c200/0xedd53ca6b6e47687 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 26419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136188.727488:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136189.746746:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789136190.141330:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:3.0:1789136190.143704:0:24752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567180032 00000100:00100000:3.0:1789136190.143718:0:24752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567180032 00000100:00100000:3.0:1789136190.143917:0:24752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 23 00000100:00100000:3.0:1789136190.143929:0:24752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0556dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8be90b6-0a63-4a05-9b5e-0fab1488262f+6:18960:x1876044567180032:12345-192.168.206.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789136190.143948:0:24752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789136190.143966:0:24752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32d000/0xedd53ca6b6e4768e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19d4d74b7ccf49b6 expref: -99 pid: 24752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136190.144034:0:24752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32c200/0xedd53ca6b6e47695 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136190.144053:0:24752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32c200/0xedd53ca6b6e47695 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136190.144067:0:24752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32c200/0xedd53ca6b6e47695 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136190.144081:0:24752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32dc00/0xedd53ca6b6e4769c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136190.144089:0:24752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32dc00/0xedd53ca6b6e4769c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136190.144095:0:24752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32dc00/0xedd53ca6b6e4769c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136190.144263:0:24752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32ce00/0xedd53ca6b6e476a3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136190.144272:0:24752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32ce00/0xedd53ca6b6e476a3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136190.144357:0:24752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32ce00/0xedd53ca6b6e476a3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24752 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789136190.144387:0:24752:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789136190.144392:0:24752:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789136190.144427:0:24752:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32ce00/0xedd53ca6b6e476a3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136190.144439:0:24752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32c200/0xedd53ca6b6e47695 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136190.144446:0:24752:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32c200/0xedd53ca6b6e47695 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136190.144452:0:24752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32c200/0xedd53ca6b6e47695 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136190.144457:0:24752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a07a32c200 already unused, calling callback (ffffffffc19d34f0) 00010000:00010000:3.0:1789136190.144461:0:24752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32c200/0xedd53ca6b6e47695 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136190.144468:0:24752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32c200/0xedd53ca6b6e47695 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136190.144479:0:24752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94a0490df400) 00010000:00010000:3.0:1789136190.144488:0:24752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789136190.144492:0:24752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32c200/0xedd53ca6b6e47695 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136190.144499:0:24752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32c200/0xedd53ca6b6e47695 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136190.144512:0:24752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32dc00/0xedd53ca6b6e4769c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136190.144517:0:24752:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32dc00/0xedd53ca6b6e4769c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136190.144523:0:24752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32dc00/0xedd53ca6b6e4769c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136190.144527:0:24752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a07a32dc00 already unused, calling callback (ffffffffc19d34f0) 00010000:00010000:3.0:1789136190.144530:0:24752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32dc00/0xedd53ca6b6e4769c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136190.145004:0:24752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32dc00/0xedd53ca6b6e4769c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136190.145017:0:24752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff94a055e92500) 00010000:00010000:3.0:1789136190.145020:0:24752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789136190.145024:0:24752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32dc00/0xedd53ca6b6e4769c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136190.145030:0:24752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32dc00/0xedd53ca6b6e4769c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136190.145065:0:24752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32d000/0xedd53ca6b6e4768e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf49b6 expref: 8 pid: 24752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136190.145092:0:24752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32ce00/0xedd53ca6b6e476a3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf49b6 expref: 7 pid: 24752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136190.145099:0:24752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff94a055e92400) 00010000:00010000:3.0:1789136190.145101:0:24752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789136190.145103:0:24752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94a07a32ce00, rc 0) 00000100:00100000:3.0:1789136190.145247:0:24752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0556dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8be90b6-0a63-4a05-9b5e-0fab1488262f+7:18960:x1876044567180032:12345-192.168.206.56@tcp:101:lhsmtool_posix.0 Request processed in 1319us (3926us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136190.145255:0:24752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 23 00000100:00100000:3.0:1789136190.148927:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:2.0:1789136190.149060:0:23389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567180160 00000100:00100000:2.0:1789136190.149069:0:23389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567180160 00000100:00100000:2.0:1789136190.149115:0:23389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 5 00000100:00100000:2.0:1789136190.149386:0:23389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f4401fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d8be90b6-0a63-4a05-9b5e-0fab1488262f+7:18960:x1876044567180160:12345-192.168.206.56@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1789136190.149467:0:23389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f4401fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d8be90b6-0a63-4a05-9b5e-0fab1488262f+7:18960:x1876044567180160:12345-192.168.206.56@tcp:900:lhsmtool_posix.0 Request processed in 342us (547us total) trans 0 rc 0/0 00000100:00080000:1.0:1789136190.149471:0:23374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789136190.149476:0:23389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 5 00000100:00100000:2.0:1789136190.153363:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:0.0:1789136190.153540:0:23379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567180416 00000100:00100000:0.0:1789136190.153548:0:23379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567180416 00000100:00100000:0.0:1789136190.153606:0:23379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 24 00000100:00100000:0.0:1789136190.153671:0:23379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0556de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8be90b6-0a63-4a05-9b5e-0fab1488262f+7:18960:x1876044567180416:12345-192.168.206.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789136190.153691:0:23379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136190.153713:0:23379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19400/0xedd53ca6b6e476aa lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19d4d74b7ccf49bd expref: -99 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.153788:0:23379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19200/0xedd53ca6b6e476b1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.153803:0:23379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19200/0xedd53ca6b6e476b1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.153815:0:23379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19200/0xedd53ca6b6e476b1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.153829:0:23379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18000/0xedd53ca6b6e476b8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.153835:0:23379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18000/0xedd53ca6b6e476b8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.153842:0:23379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18000/0xedd53ca6b6e476b8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.153940:0:23379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18e00/0xedd53ca6b6e476bf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.153948:0:23379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18e00/0xedd53ca6b6e476bf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.153955:0:23379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18e00/0xedd53ca6b6e476bf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789136190.153974:0:23379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1789136190.154140:0:23379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19200/0xedd53ca6b6e476b1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.154148:0:23379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19200/0xedd53ca6b6e476b1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.154154:0:23379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19200/0xedd53ca6b6e476b1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.154159:0:23379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff949f43a19200 already unused, calling callback (ffffffffc19d34f0) 00010000:00010000:0.0:1789136190.154163:0:23379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19200/0xedd53ca6b6e476b1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.154170:0:23379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19200/0xedd53ca6b6e476b1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.154182:0:23379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff94a055e92400) 00010000:00010000:0.0:1789136190.154185:0:23379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789136190.154189:0:23379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19200/0xedd53ca6b6e476b1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.154195:0:23379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19200/0xedd53ca6b6e476b1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.154207:0:23379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18000/0xedd53ca6b6e476b8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.154213:0:23379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18000/0xedd53ca6b6e476b8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.154227:0:23379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18000/0xedd53ca6b6e476b8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.154232:0:23379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff949f43a18000 already unused, calling callback (ffffffffc19d34f0) 00010000:00010000:0.0:1789136190.154235:0:23379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18000/0xedd53ca6b6e476b8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.154576:0:23379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18000/0xedd53ca6b6e476b8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.154587:0:23379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff949f428ff000) 00010000:00010000:0.0:1789136190.154590:0:23379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789136190.154593:0:23379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18000/0xedd53ca6b6e476b8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.154598:0:23379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18000/0xedd53ca6b6e476b8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.157281:0:23379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19400/0xedd53ca6b6e476aa lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf49bd expref: 10 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.157315:0:23379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18e00/0xedd53ca6b6e476bf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf49bd expref: 9 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.157323:0:23379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff949f428fff00) 00010000:00010000:0.0:1789136190.157326:0:23379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789136190.157329:0:23379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff949f43a18e00, rc 0) 00000100:00100000:0.0:1789136190.157398:0:23379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0556de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8be90b6-0a63-4a05-9b5e-0fab1488262f+9:18960:x1876044567180416:12345-192.168.206.56@tcp:101:lhsmtool_posix.0 Request processed in 3770us (4042us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1789136190.157421:0:23379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 24 00000100:00100000:0.0:1789136190.166585:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:2.0:1789136190.166717:0:23380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567180544 00000100:00100000:2.0:1789136190.166725:0:23380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567180544 00000100:00100000:2.0:1789136190.166795:0:23380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 25 00000100:00100000:2.0:1789136190.166806:0:23380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f44268f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8be90b6-0a63-4a05-9b5e-0fab1488262f+9:18960:x1876044567180544:12345-192.168.206.56@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789136190.166916:0:23380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f44268f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8be90b6-0a63-4a05-9b5e-0fab1488262f+9:18960:x1876044567180544:12345-192.168.206.56@tcp:59:lhsmtool_posix.0 Request processed in 112us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136190.166924:0:23380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 25 00000100:00100000:2.0:1789136190.178745:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:3.0:1789136190.178851:0:24752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567180672 00000100:00100000:3.0:1789136190.178864:0:24752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567180672 00000100:00080000:1.0:1789136190.179149:0:23374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789136190.179733:0:24752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 26 00000100:00100000:3.0:1789136190.179757:0:24752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f42b1e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8be90b6-0a63-4a05-9b5e-0fab1488262f+5:18960:x1876044567180672:12345-192.168.206.56@tcp:59:lhsmtool_posix.0 00000004:00080000:0.0:1789136190.181738:0:24752:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 1917us 00000100:00100000:0.0:1789136190.197753:0:24752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f42b1e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8be90b6-0a63-4a05-9b5e-0fab1488262f+5:18960:x1876044567180672:12345-192.168.206.56@tcp:59:lhsmtool_posix.0 Request processed in 17992us (19009us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136190.197770:0:24752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 26 00000100:00100000:3.0:1789136190.202041:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:0.0:1789136190.202305:0:23379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567180800 00000100:00100000:0.0:1789136190.202317:0:23379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567180800 00000100:00100000:0.0:1789136190.202388:0:23379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 27 00000100:00100000:0.0:1789136190.202399:0:23379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f4401d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8be90b6-0a63-4a05-9b5e-0fab1488262f+9:18966:x1876044567180800:12345-192.168.206.56@tcp:101:lfs.0 00010000:00010000:0.0:1789136190.202425:0:23379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136190.202448:0:23379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19400/0xedd53ca6b6e476cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19d4d74b7ccf49c4 expref: -99 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.202530:0:23379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18000/0xedd53ca6b6e476d4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.202548:0:23379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18000/0xedd53ca6b6e476d4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.202561:0:23379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18000/0xedd53ca6b6e476d4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.202577:0:23379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19200/0xedd53ca6b6e476db lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.202584:0:23379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19200/0xedd53ca6b6e476db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.202611:0:23379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19200/0xedd53ca6b6e476db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.202691:0:23379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18000/0xedd53ca6b6e476d4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.202698:0:23379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18000/0xedd53ca6b6e476d4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.202706:0:23379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18000/0xedd53ca6b6e476d4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.202712:0:23379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff949f43a18000 already unused, calling callback (ffffffffc19d34f0) 00010000:00010000:0.0:1789136190.202717:0:23379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18000/0xedd53ca6b6e476d4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.202725:0:23379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18000/0xedd53ca6b6e476d4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.202738:0:23379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94a0490df400) 00010000:00010000:0.0:1789136190.202740:0:23379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789136190.202745:0:23379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18000/0xedd53ca6b6e476d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.202751:0:23379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18000/0xedd53ca6b6e476d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.202765:0:23379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19200/0xedd53ca6b6e476db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.202771:0:23379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19200/0xedd53ca6b6e476db lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.202783:0:23379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19200/0xedd53ca6b6e476db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.202789:0:23379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff949f43a19200 already unused, calling callback (ffffffffc19d34f0) 00010000:00010000:0.0:1789136190.202791:0:23379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19200/0xedd53ca6b6e476db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.202797:0:23379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19200/0xedd53ca6b6e476db lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.202803:0:23379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff949f428ff000) 00010000:00010000:0.0:1789136190.202805:0:23379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789136190.202808:0:23379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19200/0xedd53ca6b6e476db lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.202814:0:23379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19200/0xedd53ca6b6e476db lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.202850:0:23379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19400/0xedd53ca6b6e476cd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf49c4 expref: 10 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.202862:0:23379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94a0490df400) 00010000:00010000:0.0:1789136190.202865:0:23379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789136190.202868:0:23379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19400/0xedd53ca6b6e476cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf49c4 expref: 10 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.202878:0:23379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff949f43a19400, rc 0) 00000100:00100000:0.0:1789136190.202958:0:23379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f4401d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8be90b6-0a63-4a05-9b5e-0fab1488262f+9:18966:x1876044567180800:12345-192.168.206.56@tcp:101:lfs.0 Request processed in 559us (933us total) trans 0 rc 301/301 00000100:00100000:0.0:1789136190.202974:0:23379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 27 00000100:00100000:3.0:1789136190.210970:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:1.0:1789136190.211114:0:23387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567180928 00000100:00100000:1.0:1789136190.211142:0:23387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567180928 00000100:00100000:1.0:1789136190.211197:0:23387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 0 00000100:00100000:1.0:1789136190.211209:0:23387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f4401cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:d8be90b6-0a63-4a05-9b5e-0fab1488262f+9:18966:x1876044567180928:12345-192.168.206.56@tcp:700:lfs.0 00000100:00100000:1.0:1789136190.211308:0:23387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f4401cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:d8be90b6-0a63-4a05-9b5e-0fab1488262f+9:18966:x1876044567180928:12345-192.168.206.56@tcp:700:lfs.0 Request processed in 102us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136190.211317:0:23387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 0 00000100:00100000:3.0:1789136190.217146:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:1.0:1789136190.217239:0:23378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567181184 00000100:00100000:1.0:1789136190.217251:0:23378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567181184 00000100:00100000:1.0:1789136190.217317:0:23378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 28 00000100:00100000:1.0:1789136190.217329:0:23378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f4401e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8be90b6-0a63-4a05-9b5e-0fab1488262f+9:18966:x1876044567181184:12345-192.168.206.56@tcp:36:lfs.0 00010000:00010000:1.0:1789136190.217401:0:23378:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789136190.217439:0:23378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94a040031a00/0xedd53ca6b6e47641 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf493f expref: 9 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136190.217463:0:23378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94a0490df400) 00010000:00010000:1.0:1789136190.217469:0:23378:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789136190.217550:0:23378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94a060036a00/0xedd53ca6b6e476e2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136190.217565:0:23378:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32d400/0xedd53ca6b6e47680 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf49af expref: 5 pid: 23378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136190.217593:0:23378:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94a060036a00/0xedd53ca6b6e476e2 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136190.217664:0:23378:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32d400/0xedd53ca6b6e47680 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf49af expref: 5 pid: 23378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136190.217680:0:23378:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32d400/0xedd53ca6b6e47680 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf49af expref: 5 pid: 23378 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136190.217696:0:23378:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a055723480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:23378:1876044587227904:192.168.206.56@tcp:104: 00000100:00100000:1.0:1789136190.217790:0:23378:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a050a309c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789136190.220210:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:1.0:1789136190.220384:0:23365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567181312 00000100:00100000:1.0:1789136190.220393:0:23365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567181312 00010000:00010000:1.0:1789136190.220456:0:23365:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32d400/0xedd53ca6b6e47680 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf49af expref: 6 pid: 23378 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136190.220498:0:23365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 15 00000100:00100000:1.0:1789136190.220508:0:23365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f4401e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1bed3215-c3a6-4f6f-b765-010543ef4acb+6:2398:x1876044567181312:12345-192.168.206.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789136190.220527:0:23365:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789136190.220534:0:23365:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32d400/0xedd53ca6b6e47680 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf49af expref: 6 pid: 23378 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136190.220548:0:23365:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32d400/0xedd53ca6b6e47680 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf49af expref: 6 pid: 23378 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136190.220574:0:23365:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94a0490df400) 00010000:00010000:1.0:1789136190.220598:0:23365:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff94a060036a00/0xedd53ca6b6e476e2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136190.220609:0:23365:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94a060036a00/0xedd53ca6b6e476e2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136190.220618:0:23365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94a060036a00/0xedd53ca6b6e476e2 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136190.220663:0:23365:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789136190.220723:0:23365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f4401e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1bed3215-c3a6-4f6f-b765-010543ef4acb+6:2398:x1876044567181312:12345-192.168.206.56@tcp:103:ldlm_bl.0 Request processed in 216us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136190.220731:0:23365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 15 00000100:00080000:3.0:1789136190.221000:0:23374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789136190.221208:0:23378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32d400/0xedd53ca6b6e47680 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf49af expref: 5 pid: 23378 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136190.221240:0:23378:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a055723480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:23378:1876044587227904:192.168.206.56@tcp:104: 00010000:00010000:2.0:1789136190.221265:0:23378:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94a060036a00/0xedd53ca6b6e476e2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.221274:0:23378:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94a060036a00/0xedd53ca6b6e476e2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.221281:0:23378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94a060036a00/0xedd53ca6b6e476e2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.221307:0:23378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94a040031e00/0xedd53ca6b6e476e9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.221316:0:23378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94a040031e00/0xedd53ca6b6e476e9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.221325:0:23378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94a040031e00/0xedd53ca6b6e476e9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.224182:0:23378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94a040030c00/0xedd53ca6b6e476f0 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.224212:0:23378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94a040030c00/0xedd53ca6b6e476f0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.224224:0:23378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94a040030c00/0xedd53ca6b6e476f0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789136190.224245:0:23378:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000bef3f250 reply state 00000000db207236 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff94a040030c00/0xedd53ca6b6e476f0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.224271:0:23378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94a040030c00/0xedd53ca6b6e476f0 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.224279:0:23378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff94a0490dfd00) 00010000:00010000:2.0:1789136190.224282:0:23378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789136190.224288:0:23378:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789136190.224295:0:23378:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789136190.224307:0:23378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94a060036a00/0xedd53ca6b6e476e2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.224314:0:23378:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94a060036a00/0xedd53ca6b6e476e2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.224322:0:23378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94a060036a00/0xedd53ca6b6e476e2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.224328:0:23378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a060036a00 already unused, calling callback (ffffffffc19d34f0) 00010000:00010000:2.0:1789136190.224333:0:23378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94a060036a00/0xedd53ca6b6e476e2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.224341:0:23378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94a060036a00/0xedd53ca6b6e476e2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.224352:0:23378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94a0490df400) 00010000:00010000:2.0:1789136190.224354:0:23378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789136190.224358:0:23378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94a060036a00/0xedd53ca6b6e476e2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.224365:0:23378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94a060036a00/0xedd53ca6b6e476e2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789136190.224397:0:23378:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000bef3f250 reply state 00000000db207236 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff94a040031e00/0xedd53ca6b6e476e9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.224406:0:23378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94a040031e00/0xedd53ca6b6e476e9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.224413:0:23378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff94a0490df000) 00010000:00010000:2.0:1789136190.224415:0:23378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789136190.224417:0:23378:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1789136190.224565:0:23378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f4401e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8be90b6-0a63-4a05-9b5e-0fab1488262f+10:18966:x1876044567181184:12345-192.168.206.56@tcp:36:lfs.0 Request processed in 7232us (7441us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1789136190.224576:0:23378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 28 00000100:00100000:3.0:1789136190.290365:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:0.0:1789136190.290520:0:24752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567181440 00000100:00100000:0.0:1789136190.290536:0:24752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567181440 00000100:00100000:0.0:1789136190.290621:0:24752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 29 00000100:00100000:0.0:1789136190.290678:0:24752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f4401de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8be90b6-0a63-4a05-9b5e-0fab1488262f+10:18974:x1876044567181440:12345-192.168.206.56@tcp:101:lctl.0 00010000:00010000:0.0:1789136190.290709:0:24752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136190.290738:0:24752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19400/0xedd53ca6b6e476f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19d4d74b7ccf49cb expref: -99 pid: 24752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.290814:0:24752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19200/0xedd53ca6b6e476fe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.290832:0:24752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19200/0xedd53ca6b6e476fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.290845:0:24752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19200/0xedd53ca6b6e476fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24752 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789136190.290899:0:24752:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789136190.290903:0:24752:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789136190.290953:0:24752:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19200/0xedd53ca6b6e476fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.291340:0:24752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19400/0xedd53ca6b6e476f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf49cb expref: 12 pid: 24752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.291364:0:24752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19200/0xedd53ca6b6e476fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf49cb expref: 11 pid: 24752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.291396:0:24752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff949f428ff000) 00010000:00010000:0.0:1789136190.291399:0:24752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789136190.291403:0:24752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff949f43a19200, rc 0) 00000100:00100000:1.0:1789136190.291942:0:24752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f4401de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8be90b6-0a63-4a05-9b5e-0fab1488262f+11:18974:x1876044567181440:12345-192.168.206.56@tcp:101:lctl.0 Request processed in 1263us (1585us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136190.291953:0:24752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 29 00000100:00100000:3.0:1789136190.317955:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:2.0:1789136190.318107:0:23380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567181568 00000100:00100000:2.0:1789136190.318140:0:23380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567181568 00000100:00100000:2.0:1789136190.318319:0:23380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 30 00000100:00100000:2.0:1789136190.318330:0:23380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f4401cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1bed3215-c3a6-4f6f-b765-010543ef4acb+5:18975:x1876044567181568:12345-192.168.206.56@tcp:101:lfs.0 00010000:00010000:2.0:1789136190.318356:0:23380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789136190.318380:0:23380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94a040030e00/0xedd53ca6b6e47705 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19d4d74b7ccf49d2 expref: -99 pid: 23380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.318474:0:23380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94a040031000/0xedd53ca6b6e4770c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.318491:0:23380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94a040031000/0xedd53ca6b6e4770c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.318504:0:23380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94a040031000/0xedd53ca6b6e4770c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23380 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789136190.318575:0:23380:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789136190.318579:0:23380:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789136190.318602:0:23380:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94a040031000/0xedd53ca6b6e4770c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.318687:0:23380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94a040030e00/0xedd53ca6b6e47705 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf49d2 expref: 7 pid: 23380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.318710:0:23380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94a040031000/0xedd53ca6b6e4770c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf49d2 expref: 6 pid: 23380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.318719:0:23380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff949f428ff000) 00010000:00010000:2.0:1789136190.318723:0:23380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789136190.318727:0:23380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94a040031000, rc 0) 00000100:00100000:2.0:1789136190.318802:0:23380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f4401cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1bed3215-c3a6-4f6f-b765-010543ef4acb+6:18975:x1876044567181568:12345-192.168.206.56@tcp:101:lfs.0 Request processed in 473us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136190.318810:0:23380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 30 00000040:00080000:1.0:1789136190.321534:0:24136:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789136190.326556:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:2.0:1789136190.326897:0:23378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567181696 00000100:00100000:2.0:1789136190.326906:0:23378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567181696 00000100:00100000:2.0:1789136190.326958:0:23378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 31 00000100:00100000:2.0:1789136190.326968:0:23378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f4401ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1bed3215-c3a6-4f6f-b765-010543ef4acb+6:18975:x1876044567181696:12345-192.168.206.56@tcp:101:lfs.0 00010000:00010000:2.0:1789136190.326987:0:23378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789136190.327007:0:23378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94a040031a00/0xedd53ca6b6e47713 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19d4d74b7ccf49d9 expref: -99 pid: 23378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.327097:0:23378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9400/0xedd53ca6b6e4771a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.327119:0:23378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9400/0xedd53ca6b6e4771a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.327146:0:23378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9400/0xedd53ca6b6e4771a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.327160:0:23378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8600/0xedd53ca6b6e47721 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.327167:0:23378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8600/0xedd53ca6b6e47721 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.327175:0:23378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8600/0xedd53ca6b6e47721 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.327243:0:23378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9a00/0xedd53ca6b6e47728 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.327251:0:23378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9a00/0xedd53ca6b6e47728 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.327258:0:23378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9a00/0xedd53ca6b6e47728 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789136190.327293:0:23378:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789136190.327296:0:23378:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789136190.327313:0:23378:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9a00/0xedd53ca6b6e47728 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.327326:0:23378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9400/0xedd53ca6b6e4771a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.327341:0:23378:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9400/0xedd53ca6b6e4771a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.327348:0:23378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9400/0xedd53ca6b6e4771a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.327354:0:23378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a0773e9400 already unused, calling callback (ffffffffc19d34f0) 00010000:00010000:2.0:1789136190.327357:0:23378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9400/0xedd53ca6b6e4771a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.327364:0:23378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9400/0xedd53ca6b6e4771a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.327376:0:23378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff949f428ff000) 00010000:00010000:2.0:1789136190.327379:0:23378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789136190.327383:0:23378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9400/0xedd53ca6b6e4771a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.327389:0:23378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9400/0xedd53ca6b6e4771a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.327404:0:23378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8600/0xedd53ca6b6e47721 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.327410:0:23378:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8600/0xedd53ca6b6e47721 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.327416:0:23378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8600/0xedd53ca6b6e47721 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.327421:0:23378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a0773e8600 already unused, calling callback (ffffffffc19d34f0) 00010000:00010000:2.0:1789136190.327430:0:23378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8600/0xedd53ca6b6e47721 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.327437:0:23378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8600/0xedd53ca6b6e47721 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.327446:0:23378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff94a0490df000) 00010000:00010000:2.0:1789136190.327448:0:23378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789136190.327451:0:23378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8600/0xedd53ca6b6e47721 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.327457:0:23378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8600/0xedd53ca6b6e47721 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.327482:0:23378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94a040031a00/0xedd53ca6b6e47713 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf49d9 expref: 8 pid: 23378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.327494:0:23378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9a00/0xedd53ca6b6e47728 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf49d9 expref: 7 pid: 23378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.327501:0:23378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff94a0490dfd00) 00010000:00010000:2.0:1789136190.327503:0:23378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789136190.327505:0:23378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94a0773e9a00, rc 0) 00000100:00100000:2.0:1789136190.327570:0:23378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f4401ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1bed3215-c3a6-4f6f-b765-010543ef4acb+7:18975:x1876044567181696:12345-192.168.206.56@tcp:101:lfs.0 Request processed in 603us (1023us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136190.327577:0:23378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 31 00000100:00100000:2.0:1789136190.330499:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:1.0:1789136190.330585:0:23390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567181824 00000100:00100000:1.0:1789136190.330601:0:23390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567181824 00000100:00100000:1.0:1789136190.331080:0:23390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 6 00000100:00100000:1.0:1789136190.331091:0:23390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f42b1c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:1bed3215-c3a6-4f6f-b765-010543ef4acb+5:18975:x1876044567181824:12345-192.168.206.56@tcp:900:lfs.0 00000100:00080000:3.0:1789136190.331236:0:23374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789136190.331573:0:23390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f42b1c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:1bed3215-c3a6-4f6f-b765-010543ef4acb+5:18975:x1876044567181824:12345-192.168.206.56@tcp:900:lfs.0 Request processed in 480us (1080us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136190.331584:0:23390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 6 00000100:00100000:3.0:1789136190.336443:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:0.0:1789136190.336525:0:24752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567182080 00000100:00100000:0.0:1789136190.336536:0:24752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567182080 00000100:00100000:0.0:1789136190.336606:0:24752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 32 00000100:00100000:0.0:1789136190.336648:0:24752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f4401e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1bed3215-c3a6-4f6f-b765-010543ef4acb+7:18975:x1876044567182080:12345-192.168.206.56@tcp:101:lfs.0 00010000:00010000:0.0:1789136190.336677:0:24752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136190.336704:0:24752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19400/0xedd53ca6b6e4772f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19d4d74b7ccf49e0 expref: -99 pid: 24752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789136190.336836:0:24752:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789136190.336972:0:24752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19400/0xedd53ca6b6e4772f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf49e0 expref: 9 pid: 24752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.336996:0:24752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff949f428ff000) 00010000:00010000:0.0:1789136190.337000:0:24752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789136190.337005:0:24752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19400/0xedd53ca6b6e4772f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf49e0 expref: 9 pid: 24752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.337021:0:24752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff949f43a19400, rc 0) 00000100:00100000:0.0:1789136190.337889:0:24752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f4401e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1bed3215-c3a6-4f6f-b765-010543ef4acb+8:18975:x1876044567182080:12345-192.168.206.56@tcp:101:lfs.0 Request processed in 1266us (1471us total) trans 12884901891 rc 301/301 00000100:00100000:0.0:1789136190.337901:0:24752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 32 00000100:00100000:3.0:1789136190.341269:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:0.0:1789136190.341539:0:23380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567182336 00000100:00100000:0.0:1789136190.341568:0:23380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567182336 00000100:00100000:0.0:1789136190.341679:0:23380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 33 00000100:00100000:0.0:1789136190.341692:0:23380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f4401d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1bed3215-c3a6-4f6f-b765-010543ef4acb+8:18975:x1876044567182336:12345-192.168.206.56@tcp:36:lfs.0 00010000:00010000:0.0:1789136190.341761:0:23380:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789136190.341799:0:23380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9a00/0xedd53ca6b6e47728 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf49d9 expref: 8 pid: 23378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.341828:0:23380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff94a0490dfd00) 00010000:00010000:0.0:1789136190.341835:0:23380:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789136190.341864:0:23380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18000/0xedd53ca6b6e4773d lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.341880:0:23380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18000/0xedd53ca6b6e4773d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.341892:0:23380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18000/0xedd53ca6b6e4773d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23380 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789136190.342353:0:23380:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000f4c3a402 reply state 00000000486391ea transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18000/0xedd53ca6b6e4773d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.342369:0:23380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18000/0xedd53ca6b6e4773d lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.342377:0:23380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff94a0490dfd00) 00010000:00010000:0.0:1789136190.342380:0:23380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1789136190.342382:0:23380:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789136190.342391:0:23380:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1789136190.342604:0:23380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f4401d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1bed3215-c3a6-4f6f-b765-010543ef4acb+9:18975:x1876044567182336:12345-192.168.206.56@tcp:36:lfs.0 Request processed in 912us (1348us total) trans 12884901892 rc 0/0 00000100:00100000:0.0:1789136190.342613:0:23380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 33 00000100:00100000:1.0:1789136190.348010:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:0.0:1789136190.348107:0:23381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567182592 00000100:00100000:0.0:1789136190.348115:0:23381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567182592 00000100:00100000:0.0:1789136190.348182:0:23381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 2 00000100:00100000:0.0:1789136190.348191:0:23381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0557212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1bed3215-c3a6-4f6f-b765-010543ef4acb+9:18975:x1876044567182592:12345-192.168.206.56@tcp:35:lfs.0 00000100:00100000:0.0:1789136190.348399:0:23381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0557212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1bed3215-c3a6-4f6f-b765-010543ef4acb+10:18975:x1876044567182592:12345-192.168.206.56@tcp:35:lfs.0 Request processed in 208us (398us total) trans 12884901893 rc 0/0 00000100:00100000:0.0:1789136190.348407:0:23381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 2 00000100:00100000:2.0:1789136190.351194:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:0.0:1789136190.351267:0:23379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567182848 00000100:00100000:0.0:1789136190.351274:0:23379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567182848 00000100:00100000:0.0:1789136190.351333:0:23379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 34 00000100:00100000:0.0:1789136190.351343:0:23379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a07f6e8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1bed3215-c3a6-4f6f-b765-010543ef4acb+10:18975:x1876044567182848:12345-192.168.206.56@tcp:101:lfs.0 00010000:00010000:0.0:1789136190.351370:0:23379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136190.351390:0:23379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19600/0xedd53ca6b6e47744 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19d4d74b7ccf49e7 expref: -99 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.351461:0:23379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19e00/0xedd53ca6b6e4774b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.351474:0:23379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19e00/0xedd53ca6b6e4774b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.351483:0:23379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19e00/0xedd53ca6b6e4774b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.351493:0:23379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19a00/0xedd53ca6b6e47752 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.351500:0:23379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19a00/0xedd53ca6b6e47752 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.351524:0:23379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19a00/0xedd53ca6b6e47752 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789136190.351617:0:23379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789136190.351718:0:23379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19e00/0xedd53ca6b6e4774b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.351726:0:23379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19e00/0xedd53ca6b6e4774b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.351733:0:23379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19e00/0xedd53ca6b6e4774b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.351739:0:23379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff949f43a19e00 already unused, calling callback (ffffffffc19d34f0) 00010000:00010000:0.0:1789136190.351742:0:23379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19e00/0xedd53ca6b6e4774b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.351749:0:23379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19e00/0xedd53ca6b6e4774b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.351761:0:23379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff949f428ff000) 00010000:00010000:0.0:1789136190.351764:0:23379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789136190.351768:0:23379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19e00/0xedd53ca6b6e4774b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.351775:0:23379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19e00/0xedd53ca6b6e4774b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.351787:0:23379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19a00/0xedd53ca6b6e47752 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.351803:0:23379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19a00/0xedd53ca6b6e47752 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.351809:0:23379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19a00/0xedd53ca6b6e47752 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.351814:0:23379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff949f43a19a00 already unused, calling callback (ffffffffc19d34f0) 00010000:00010000:0.0:1789136190.351817:0:23379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19a00/0xedd53ca6b6e47752 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.351823:0:23379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19a00/0xedd53ca6b6e47752 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.351831:0:23379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff94a0490df000) 00010000:00010000:0.0:1789136190.351833:0:23379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789136190.351837:0:23379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19a00/0xedd53ca6b6e47752 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.351842:0:23379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19a00/0xedd53ca6b6e47752 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.351877:0:23379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19600/0xedd53ca6b6e47744 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf49e7 expref: 12 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.351887:0:23379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff949f428ff000) 00010000:00010000:0.0:1789136190.351890:0:23379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789136190.351893:0:23379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19600/0xedd53ca6b6e47744 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf49e7 expref: 12 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.351915:0:23379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff949f43a19600, rc 0) 00000100:00100000:0.0:1789136190.351970:0:23379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a07f6e8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1bed3215-c3a6-4f6f-b765-010543ef4acb+11:18975:x1876044567182848:12345-192.168.206.56@tcp:101:lfs.0 Request processed in 628us (782us total) trans 12884901894 rc 301/301 00000100:00100000:0.0:1789136190.351978:0:23379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 34 00000100:00100000:1.0:1789136190.360939:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:0.0:1789136190.361043:0:24752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567182976 00000100:00100000:0.0:1789136190.361053:0:24752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567182976 00000100:00100000:0.0:1789136190.361116:0:24752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 35 00000100:00100000:0.0:1789136190.361141:0:24752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a055723480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1bed3215-c3a6-4f6f-b765-010543ef4acb+11:18975:x1876044567182976:12345-192.168.206.56@tcp:101:lfs.0 00010000:00010000:0.0:1789136190.361164:0:24752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136190.361183:0:24752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19600/0xedd53ca6b6e47760 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19d4d74b7ccf49ee expref: -99 pid: 24752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.361291:0:24752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19a00/0xedd53ca6b6e47767 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.361306:0:24752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19a00/0xedd53ca6b6e47767 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.361317:0:24752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19a00/0xedd53ca6b6e47767 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24752 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789136190.361343:0:24752:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789136190.361346:0:24752:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789136190.361364:0:24752:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19a00/0xedd53ca6b6e47767 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.361390:0:24752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19600/0xedd53ca6b6e47760 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf49ee expref: 13 pid: 24752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.361420:0:24752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19a00/0xedd53ca6b6e47767 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf49ee expref: 12 pid: 24752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.361429:0:24752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff94a0490dfd00) 00010000:00010000:0.0:1789136190.361432:0:24752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789136190.361435:0:24752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff949f43a19a00, rc 0) 00000100:00100000:0.0:1789136190.361501:0:24752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a055723480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1bed3215-c3a6-4f6f-b765-010543ef4acb+12:18975:x1876044567182976:12345-192.168.206.56@tcp:101:lfs.0 Request processed in 375us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136190.361508:0:24752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 35 00000100:00100000:1.0:1789136190.370904:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:0.0:1789136190.370981:0:23381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567183104 00000100:00100000:0.0:1789136190.370989:0:23381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567183104 00000100:00100000:0.0:1789136190.371044:0:23381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 3 00000100:00100000:0.0:1789136190.371053:0:23381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a055723840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1bed3215-c3a6-4f6f-b765-010543ef4acb+12:18975:x1876044567183104:12345-192.168.206.56@tcp:37:lfs.0 00000100:00100000:0.0:1789136190.377293:0:23381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a055723840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1bed3215-c3a6-4f6f-b765-010543ef4acb+12:18975:x1876044567183104:12345-192.168.206.56@tcp:37:lfs.0 Request processed in 6232us (6388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136190.377307:0:23381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 3 00000100:00100000:1.0:1789136190.380518:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:2.0:1789136190.380611:0:23382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567183360 00000100:00100000:2.0:1789136190.380620:0:23382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567183360 00000100:00100000:2.0:1789136190.380720:0:23382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 4 00000100:00100000:2.0:1789136190.380729:0:23382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f43b9b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1bed3215-c3a6-4f6f-b765-010543ef4acb+12:18975:x1876044567183360:12345-192.168.206.56@tcp:35:lfs.0 00000100:00100000:2.0:1789136190.380935:0:23382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f43b9b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1bed3215-c3a6-4f6f-b765-010543ef4acb+13:18975:x1876044567183360:12345-192.168.206.56@tcp:35:lfs.0 Request processed in 207us (426us total) trans 12884901895 rc 0/0 00000100:00100000:2.0:1789136190.380943:0:23382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 4 00000100:00100000:1.0:1789136190.439830:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:3.0:1789136190.439903:0:23373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567183488 00000100:00100000:3.0:1789136190.439922:0:23373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567183488 00000100:00100000:3.0:1789136190.439991:0:23373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 147 00000100:00100000:3.0:1789136190.440002:0:23373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a076bd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbab00a5-62cb-4304-af69-c2de8be80f81+11:18337:x1876044567183488:12345-192.168.206.56@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789136190.440018:0:23373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789136190.440036:0:23373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94a07a32d000/0xedd53ca6b6e4776e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19d4d74b7ccf49f5 expref: -99 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136190.440062:0:23373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94a07a32d000/0xedd53ca6b6e4776e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf49f5 expref: 12 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136190.440073:0:23373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94a07a32d000/0xedd53ca6b6e4776e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf49f5 expref: 12 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136190.440082:0:23373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94a07a32d000, rc 0) 00000100:00100000:3.0:1789136190.440150:0:23373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a076bd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbab00a5-62cb-4304-af69-c2de8be80f81+12:18337:x1876044567183488:12345-192.168.206.56@tcp:101:ll_cfg_requeue.0 Request processed in 150us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136190.440158:0:23373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 147 00000100:00100000:3.0:1789136190.446714:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:1.0:1789136190.446959:0:23371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567183616 00000100:00100000:1.0:1789136190.446978:0:23371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567183616 00000100:00100000:1.0:1789136190.447032:0:23371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 148 00000100:00100000:1.0:1789136190.447041:0:23371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a076bd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbab00a5-62cb-4304-af69-c2de8be80f81+12:18337:x1876044567183616:12345-192.168.206.56@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789136190.447223:0:23371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a076bd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbab00a5-62cb-4304-af69-c2de8be80f81+12:18337:x1876044567183616:12345-192.168.206.56@tcp:501:ll_cfg_requeue.0 Request processed in 182us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136190.447231:0:23371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 148 00000100:00100000:1.0:1789136190.450363:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:2.0:1789136190.450510:0:23378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567183744 00000100:00100000:2.0:1789136190.450524:0:23378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567183744 00000100:00100000:2.0:1789136190.450655:0:23378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 36 00000100:00100000:2.0:1789136190.450665:0:23378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a055720000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8be90b6-0a63-4a05-9b5e-0fab1488262f+11:18981:x1876044567183744:12345-192.168.206.56@tcp:101:bash.0 00010000:00010000:2.0:1789136190.450682:0:23378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789136190.450703:0:23378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9400/0xedd53ca6b6e47775 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19d4d74b7ccf49fc expref: -99 pid: 23378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.450763:0:23378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8e00/0xedd53ca6b6e4777c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.450777:0:23378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8e00/0xedd53ca6b6e4777c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.450788:0:23378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8e00/0xedd53ca6b6e4777c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.450799:0:23378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9000/0xedd53ca6b6e47783 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.450806:0:23378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9000/0xedd53ca6b6e47783 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.450813:0:23378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9000/0xedd53ca6b6e47783 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.450902:0:23378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8c00/0xedd53ca6b6e4778a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.450911:0:23378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8c00/0xedd53ca6b6e4778a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.450918:0:23378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8c00/0xedd53ca6b6e4778a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789136190.450950:0:23378:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789136190.450954:0:23378:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789136190.451003:0:23378:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8c00/0xedd53ca6b6e4778a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.451014:0:23378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8e00/0xedd53ca6b6e4777c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.451020:0:23378:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8e00/0xedd53ca6b6e4777c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.451027:0:23378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8e00/0xedd53ca6b6e4777c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.451034:0:23378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a0773e8e00 already unused, calling callback (ffffffffc19d34f0) 00010000:00010000:2.0:1789136190.451038:0:23378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8e00/0xedd53ca6b6e4777c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.451044:0:23378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8e00/0xedd53ca6b6e4777c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.451056:0:23378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff949f428ff000) 00010000:00010000:2.0:1789136190.451077:0:23378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789136190.451083:0:23378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8e00/0xedd53ca6b6e4777c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.451090:0:23378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8e00/0xedd53ca6b6e4777c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.451106:0:23378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9000/0xedd53ca6b6e47783 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.451113:0:23378:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9000/0xedd53ca6b6e47783 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.451120:0:23378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9000/0xedd53ca6b6e47783 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.451136:0:23378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a0773e9000 already unused, calling callback (ffffffffc19d34f0) 00010000:00010000:2.0:1789136190.451139:0:23378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9000/0xedd53ca6b6e47783 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.451145:0:23378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9000/0xedd53ca6b6e47783 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.451153:0:23378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff94a0490df000) 00010000:00010000:2.0:1789136190.451156:0:23378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789136190.451159:0:23378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9000/0xedd53ca6b6e47783 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.451164:0:23378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9000/0xedd53ca6b6e47783 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.451189:0:23378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9400/0xedd53ca6b6e47775 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf49fc expref: 13 pid: 23378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.451216:0:23378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8c00/0xedd53ca6b6e4778a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf49fc expref: 12 pid: 23378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.451224:0:23378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff94a0490dfd00) 00010000:00010000:2.0:1789136190.451226:0:23378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789136190.451228:0:23378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94a0773e8c00, rc 0) 00000100:00100000:2.0:1789136190.451290:0:23378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a055720000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8be90b6-0a63-4a05-9b5e-0fab1488262f+12:18981:x1876044567183744:12345-192.168.206.56@tcp:101:bash.0 Request processed in 626us (942us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136190.451298:0:23378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 36 00000100:00100000:2.0:1789136190.458943:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:3.0:1789136190.459062:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567183872 00000100:00100000:3.0:1789136190.459074:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567183872 00000100:00100000:3.0:1789136190.459267:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 149 00000100:00100000:3.0:1789136190.459280:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a076bd0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbab00a5-62cb-4304-af69-c2de8be80f81+12:18337:x1876044567183872:12345-192.168.206.56@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789136190.460168:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a076bd0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbab00a5-62cb-4304-af69-c2de8be80f81+12:18337:x1876044567183872:12345-192.168.206.56@tcp:503:ll_cfg_requeue.0 Request processed in 297us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136190.460185:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 149 00000100:00100000:3.0:1789136190.465390:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:3.0:1789136190.465800:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:2.0:1789136190.465941:0:23389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567184000 00000100:00100000:2.0:1789136190.465954:0:23389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567184000 00000100:00100000:2.0:1789136190.466032:0:23389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 7 00000100:00100000:2.0:1789136190.466044:0:23389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a04373e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d8be90b6-0a63-4a05-9b5e-0fab1488262f+5:18981:x1876044567184000:12345-192.168.206.56@tcp:900:bash.0 00000100:00100000:2.0:1789136190.466171:0:23389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a04373e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d8be90b6-0a63-4a05-9b5e-0fab1488262f+5:18981:x1876044567184000:12345-192.168.206.56@tcp:900:bash.0 Request processed in 128us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136190.466180:0:23389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 7 00000100:00100000:0.0:1789136190.466904:0:23373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567184128 00000100:00100000:0.0:1789136190.466913:0:23373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567184128 00000100:00100000:0.0:1789136190.466960:0:23373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 150 00000100:00100000:0.0:1789136190.466968:0:23373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a076bd0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbab00a5-62cb-4304-af69-c2de8be80f81+12:18337:x1876044567184128:12345-192.168.206.56@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789136190.466982:0:23373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136190.467002:0:23373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff949f43a19600/0xedd53ca6b6e47791 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x19d4d74b7ccf4a03 expref: -99 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.467042:0:23373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff949f43a19600/0xedd53ca6b6e47791 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a03 expref: 13 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.468392:0:23373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff949f43a19600/0xedd53ca6b6e47791 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a03 expref: 13 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.468403:0:23373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff949f43a19600, rc 0) 00000100:00100000:0.0:1789136190.468486:0:23373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a076bd0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbab00a5-62cb-4304-af69-c2de8be80f81+13:18337:x1876044567184128:12345-192.168.206.56@tcp:101:ll_cfg_requeue.0 Request processed in 1517us (2685us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136190.468496:0:23373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 150 00000100:00100000:3.0:1789136190.470355:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:2.0:1789136190.470487:0:26186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567184384 00000100:00100000:2.0:1789136190.470501:0:26186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567184384 00000100:00100000:2.0:1789136190.470753:0:26186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 37 00000100:00100000:2.0:1789136190.470766:0:26186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a04373c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d8be90b6-0a63-4a05-9b5e-0fab1488262f+12:18981:x1876044567184384:12345-192.168.206.56@tcp:101:bash.0 00010000:00010000:2.0:1789136190.470793:0:26186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789136190.470822:0:26186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8e00/0xedd53ca6b6e47798 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19d4d74b7ccf4a0a expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.470989:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8400/0xedd53ca6b6e4779f lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.471007:0:26186:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19a00/0xedd53ca6b6e47767 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf49ee expref: 12 pid: 24752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.471017:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8400/0xedd53ca6b6e4779f lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.471059:0:26186:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19a00/0xedd53ca6b6e47767 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf49ee expref: 12 pid: 24752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.471075:0:26186:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19a00/0xedd53ca6b6e47767 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf49ee expref: 12 pid: 24752 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136190.471091:0:26186:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07f6eb0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:26186:1876044587228032:192.168.206.56@tcp:104: 00000100:00100000:2.0:1789136190.471210:0:26186:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a050ae7600 going to sleep for 11 seconds 00000100:00100000:3.0:1789136190.472325:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:1.0:1789136190.475052:0:23371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567184512 00000100:00100000:1.0:1789136190.475072:0:23371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567184512 00000100:00100000:1.0:1789136190.475315:0:23371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 151 00000100:00100000:1.0:1789136190.475329:0:23371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a049033c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbab00a5-62cb-4304-af69-c2de8be80f81+13:18337:x1876044567184512:12345-192.168.206.56@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789136190.475564:0:23371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a049033c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbab00a5-62cb-4304-af69-c2de8be80f81+13:18337:x1876044567184512:12345-192.168.206.56@tcp:501:ll_cfg_requeue.0 Request processed in 238us (3249us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136190.475736:0:23371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 151 00000100:00100000:2.0:1789136190.480192:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:0.0:1789136190.480342:0:26186:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07f6eb0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:26186:1876044587228032:192.168.206.56@tcp:104: 00010000:00010000:0.0:1789136190.480376:0:26186:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8400/0xedd53ca6b6e4779f lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136190.480861:0:23373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567184640 00000100:00100000:3.0:1789136190.480870:0:23373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567184640 00000100:00100000:3.0:1789136190.481004:0:23373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 152 00000100:00100000:3.0:1789136190.481015:0:23373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a049032c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbab00a5-62cb-4304-af69-c2de8be80f81+13:18337:x1876044567184640:12345-192.168.206.56@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789136190.481230:0:23373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a049032c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbab00a5-62cb-4304-af69-c2de8be80f81+13:18337:x1876044567184640:12345-192.168.206.56@tcp:503:ll_cfg_requeue.0 Request processed in 216us (1052us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136190.481239:0:23373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 152 00000100:00100000:2.0:1789136190.482775:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:1.0:1789136190.483227:0:23364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567184768 00000100:00100000:1.0:1789136190.483238:0:23364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567184768 00010000:00010000:1.0:1789136190.483289:0:23364:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19a00/0xedd53ca6b6e47767 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf49ee expref: 13 pid: 24752 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136190.483337:0:23364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 16 00000100:00100000:1.0:1789136190.483348:0:23364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a07f6e8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1bed3215-c3a6-4f6f-b765-010543ef4acb+13:2398:x1876044567184768:12345-192.168.206.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789136190.483367:0:23364:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789136190.483374:0:23364:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19a00/0xedd53ca6b6e47767 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf49ee expref: 13 pid: 24752 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136190.483411:0:23364:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19a00/0xedd53ca6b6e47767 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf49ee expref: 13 pid: 24752 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136190.483800:0:23364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19a00/0xedd53ca6b6e47767 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf49ee expref: 13 pid: 24752 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136190.483823:0:23364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff94a0490dfd00) 00010000:00010000:1.0:1789136190.483829:0:23364:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8400/0xedd53ca6b6e4779f lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136190.483841:0:23364:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8400/0xedd53ca6b6e4779f lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136190.483849:0:23364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8400/0xedd53ca6b6e4779f lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136190.483930:0:23364:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789136190.484011:0:23364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a07f6e8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1bed3215-c3a6-4f6f-b765-010543ef4acb+12:2398:x1876044567184768:12345-192.168.206.56@tcp:103:ldlm_bl.0 Request processed in 663us (1248us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136190.484021:0:23364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 16 00010000:00010000:0.0:1789136190.486959:0:26186:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8400/0xedd53ca6b6e4779f lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.486990:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8400/0xedd53ca6b6e4779f lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.490030:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19400/0xedd53ca6b6e477a6 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.490060:0:26186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19400/0xedd53ca6b6e477a6 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.490072:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19400/0xedd53ca6b6e477a6 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.490573:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18600/0xedd53ca6b6e477ad lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.490602:0:26186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18600/0xedd53ca6b6e477ad lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.490610:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18600/0xedd53ca6b6e477ad lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789136190.490623:0:26186:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789136190.490679:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8400/0xedd53ca6b6e4779f lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.490688:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8400/0xedd53ca6b6e4779f lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.490695:0:26186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8400/0xedd53ca6b6e4779f lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.490701:0:26186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a0773e8400 already unused, calling callback (ffffffffc19d34f0) 00010000:00010000:0.0:1789136190.490705:0:26186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8400/0xedd53ca6b6e4779f lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.490713:0:26186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8400/0xedd53ca6b6e4779f lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.490726:0:26186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff94a0490dfd00) 00010000:00010000:0.0:1789136190.490729:0:26186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789136190.490734:0:26186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8400/0xedd53ca6b6e4779f lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.490740:0:26186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8400/0xedd53ca6b6e4779f lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789136190.490755:0:26186:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000de6f8e39 reply state 000000007f5bc950 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19400/0xedd53ca6b6e477a6 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.490775:0:26186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19400/0xedd53ca6b6e477a6 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.490783:0:26186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff949f428ffb00) 00010000:00010000:0.0:1789136190.490785:0:26186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789136190.490790:0:26186:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789136190.490834:0:26186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8e00/0xedd53ca6b6e47798 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a0a expref: 15 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.490855:0:26186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18600/0xedd53ca6b6e477ad lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a0a expref: 14 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.490863:0:26186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff949f428ff400) 00010000:00010000:0.0:1789136190.490866:0:26186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1789136190.490869:0:26186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff949f43a18600, rc 0) 00000100:00100000:0.0:1789136190.491125:0:26186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a04373c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d8be90b6-0a63-4a05-9b5e-0fab1488262f+15:18981:x1876044567184384:12345-192.168.206.56@tcp:101:bash.0 Request processed in 20362us (20781us total) trans 12884901896 rc 0/0 00000100:00100000:0.0:1789136190.491143:0:26186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 37 10000000:01000000:2.0:1789136190.512960:0:23375:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789136190.512973:0:23375:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94a0819e7000 from 19 10000000:01000000:2.0:1789136190.512979:0:23375:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789136190.513053:0:23375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a0773e9600/0xedd53ca6b6e477bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.513066:0:23375:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.156@tcp lock: ffff94a0773e9600/0xedd53ca6b6e477bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.513191:0:23375:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.156@tcp lock: ffff94a0773e9600/0xedd53ca6b6e477bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136190.513223:0:23375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07f6e8f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23375:1876044587228160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789136190.513230:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:2.0:1789136190.513290:0:23375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136190.513339:0:23375:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a050ae76c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789136190.513339:0:23380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567184896 00000100:00100000:0.0:1789136190.513348:0:23380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567184896 00000100:00100000:0.0:1789136190.513422:0:23380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 38 00000100:00100000:0.0:1789136190.513445:0:23380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a04373f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8be90b6-0a63-4a05-9b5e-0fab1488262f+15:18981:x1876044567184896:12345-192.168.206.56@tcp:101:bash.0 00010000:00010000:0.0:1789136190.513472:0:23380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136190.513492:0:23380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18400/0xedd53ca6b6e477c2 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19d4d74b7ccf4a11 expref: -99 pid: 23380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.513571:0:23380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19a00/0xedd53ca6b6e477c9 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.513596:0:23380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19a00/0xedd53ca6b6e477c9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.513610:0:23380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19a00/0xedd53ca6b6e477c9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23380 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789136190.513711:0:23380:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789136190.513716:0:23380:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789136190.513737:0:23380:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19a00/0xedd53ca6b6e477c9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.513750:0:23380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19a00/0xedd53ca6b6e477c9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.513792:0:23380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18400/0xedd53ca6b6e477c2 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a11 expref: 17 pid: 23380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.513813:0:23380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19a00/0xedd53ca6b6e477c9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a11 expref: 16 pid: 23380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.513822:0:23380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff949f428ff400) 00010000:00010000:0.0:1789136190.513825:0:23380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789136190.513829:0:23380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff949f43a19a00, rc 0) 00000100:00100000:0.0:1789136190.513896:0:23380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a04373f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8be90b6-0a63-4a05-9b5e-0fab1488262f+16:18981:x1876044567184896:12345-192.168.206.56@tcp:101:bash.0 Request processed in 464us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136190.513904:0:23380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 38 00000100:00100000:1.0:1789136190.513989:0:23371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587228160 00000100:00100000:1.0:1789136190.513995:0:23371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587228160 00000100:00100000:1.0:1789136190.514036:0:23371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789136190.514043:0:23371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a049030050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+20:23375:x1876044587228160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789136190.514052:0:23371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789136190.514064:0:23371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94a060036000/0xedd53ca6b6e477d0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xedd53ca6b6e477bb expref: -99 pid: 23371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136190.514096:0:23371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94a060036000/0xedd53ca6b6e477d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedd53ca6b6e477bb expref: 21 pid: 23371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136190.514105:0:23371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94a060036000/0xedd53ca6b6e477d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedd53ca6b6e477bb expref: 21 pid: 23371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136190.514112:0:23371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94a060036000, rc 0) 00000100:00100000:1.0:1789136190.514169:0:23371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a049030050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+21:23375:x1876044587228160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (878us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136190.514177:0:23371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789136190.514228:0:23375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07f6e8f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23375:1876044587228160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789136190.514245:0:23375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.156@tcp lock: ffff94a0773e9600/0xedd53ca6b6e477bb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e477d0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136190.514254:0:23375:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.156@tcp lock: ffff94a0773e9600/0xedd53ca6b6e477bb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xedd53ca6b6e477d0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136190.514333:0:23375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a055722940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23375:1876044587228288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789136190.514365:0:23375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136190.514388:0:23375:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a050a309c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789136190.515396:0:23373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587228288 00000100:00100000:3.0:1789136190.515408:0:23373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587228288 00000100:00100000:3.0:1789136190.515477:0:23373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789136190.515487:0:23373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a049031850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3644072c-bb98-4fbe-9eaf-e40d57d161d0+21:23375:x1876044587228288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789136190.515681:0:23373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a049031850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3644072c-bb98-4fbe-9eaf-e40d57d161d0+21:23375:x1876044587228288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 195us (1314us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136190.515689:0:23373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789136190.516005:0:23375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a055722940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23375:1876044587228288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789136190.516061:0:23375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a055722940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23375:1876044587228416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789136190.516135:0:23375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136190.516172:0:23375:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a050a309c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789136190.516189:0:23371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587228416 00000100:00100000:1.0:1789136190.516201:0:23371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587228416 00000100:00100000:1.0:1789136190.516227:0:23371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789136190.516234:0:23371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a049030850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+21:23375:x1876044587228416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789136190.516350:0:23371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a049030850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+21:23375:x1876044587228416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 115us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136190.516358:0:23371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789136190.516408:0:23375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a055722940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23375:1876044587228416:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789136190.517394:0:26433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 19 00000020:01000000:2.0:1789136190.519597:0:23375:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 19-18 (rc=0) 10000000:01000000:2.0:1789136190.519736:0:23375:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789136190.519751:0:23375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a0773e9600/0xedd53ca6b6e477bb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e477d0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.519766:0:23375:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.156@tcp lock: ffff94a0773e9600/0xedd53ca6b6e477bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e477d0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789136190.519778:0:23375:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789136190.519781:0:23375:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94a0660f3000 from 19 10000000:01000000:2.0:1789136190.519784:0:23375:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789136190.519839:0:23375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a0773e8800/0xedd53ca6b6e477d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.519847:0:23375:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.156@tcp lock: ffff94a0773e8800/0xedd53ca6b6e477d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.519858:0:23375:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.156@tcp lock: ffff94a0773e8800/0xedd53ca6b6e477d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136190.519889:0:23375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07f6e9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23375:1876044587228544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789136190.519971:0:23375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136190.520170:0:23375:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a050ae76c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789136190.520278:0:23371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587228544 00000100:00100000:1.0:1789136190.520287:0:23371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587228544 00000100:00100000:1.0:1789136190.520379:0:23371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789136190.520391:0:23371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a049031c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+21:23375:x1876044587228544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789136190.520407:0:23371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789136190.520423:0:23371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94a060037600/0xedd53ca6b6e477de lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xedd53ca6b6e477d7 expref: -99 pid: 23371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136190.520463:0:23371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94a060037600/0xedd53ca6b6e477de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedd53ca6b6e477d7 expref: 22 pid: 23371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136190.520475:0:23371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94a060037600/0xedd53ca6b6e477de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedd53ca6b6e477d7 expref: 22 pid: 23371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136190.520486:0:23371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94a060037600, rc 0) 00000100:00100000:1.0:1789136190.520539:0:23371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a049031c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+22:23375:x1876044587228544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136190.520546:0:23371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789136190.520653:0:23375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07f6e9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23375:1876044587228544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789136190.520671:0:23375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.156@tcp lock: ffff94a0773e8800/0xedd53ca6b6e477d7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e477de expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.520681:0:23375:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.156@tcp lock: ffff94a0773e8800/0xedd53ca6b6e477d7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xedd53ca6b6e477de expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136190.520751:0:23375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07f6e9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23375:1876044587228672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789136190.520782:0:23375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136190.521065:0:23375:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a050ae76c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789136190.521229:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587228672 00000100:00100000:0.0:1789136190.521234:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587228672 00000100:00100000:0.0:1789136190.521265:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789136190.521287:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a049032450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+22:23375:x1876044587228672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789136190.521587:0:23375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07f6e9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23375:1876044587228672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789136190.521646:0:23375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07f6e9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23375:1876044587228800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789136190.521694:0:23375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136190.521704:0:23375:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a050ae76c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789136190.521773:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a049032450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+22:23375:x1876044587228672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 488us (989us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136190.521782:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789136190.521808:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587228800 00000100:00100000:0.0:1789136190.521811:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587228800 00000100:00100000:0.0:1789136190.521828:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789136190.521834:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a049031450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+22:23375:x1876044587228800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789136190.521917:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a049031450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+22:23375:x1876044587228800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136190.521924:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789136190.522010:0:23375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07f6e9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23375:1876044587228800:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789136190.523263:0:26434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 19 00000020:01000000:0.0:1789136190.526107:0:23375:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 19-18 (rc=0) 10000000:01000000:0.0:1789136190.526166:0:23375:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789136190.526182:0:23375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a0773e8800/0xedd53ca6b6e477d7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e477de expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.526197:0:23375:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.156@tcp lock: ffff94a0773e8800/0xedd53ca6b6e477d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e477de expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789136190.526211:0:23375:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789136190.526214:0:23375:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff949f43b2f800 from 19 10000000:01000000:0.0:1789136190.526218:0:23375:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789136190.526270:0:23375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.156@tcp lock: ffff949f43a18400/0xedd53ca6b6e477e5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.526279:0:23375:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.156@tcp lock: ffff949f43a18400/0xedd53ca6b6e477e5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.526291:0:23375:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.156@tcp lock: ffff949f43a18400/0xedd53ca6b6e477e5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136190.526346:0:23375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f442692c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23375:1876044587228928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789136190.526512:0:23375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136190.526601:0:23375:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a0468d1cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789136190.527197:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:3.0:1789136190.527384:0:23382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567185152 00000100:00100000:3.0:1789136190.527394:0:23382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567185152 00000100:00100000:3.0:1789136190.527506:0:23382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 5 00000100:00100000:3.0:1789136190.527529:0:23382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a055722940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d8be90b6-0a63-4a05-9b5e-0fab1488262f+16:18981:x1876044567185152:12345-192.168.206.56@tcp:35:bash.0 00000100:00100000:3.0:1789136190.527976:0:23382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a055722940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d8be90b6-0a63-4a05-9b5e-0fab1488262f+17:18981:x1876044567185152:12345-192.168.206.56@tcp:35:bash.0 Request processed in 457us (780us total) trans 12884901897 rc 0/0 00000100:00100000:3.0:1789136190.527986:0:23382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 5 00000100:00100000:2.0:1789136190.529382:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587228928 00000100:00100000:2.0:1789136190.529399:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587228928 00000100:00100000:2.0:1789136190.529504:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789136190.529525:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a049030c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+22:23375:x1876044587228928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789136190.529554:0:23372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789136190.529846:0:23372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94a0773e8a00/0xedd53ca6b6e477ec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xedd53ca6b6e477e5 expref: -99 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.529884:0:23372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94a0773e8a00/0xedd53ca6b6e477ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedd53ca6b6e477e5 expref: 23 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.529917:0:23372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94a0773e8a00/0xedd53ca6b6e477ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedd53ca6b6e477e5 expref: 23 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.529928:0:23372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94a0773e8a00, rc 0) 00000100:00100000:2.0:1789136190.530022:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a049030c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+23:23375:x1876044587228928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 509us (3510us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136190.530031:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789136190.530363:0:23375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f442692c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23375:1876044587228928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789136190.530387:0:23375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.156@tcp lock: ffff949f43a18400/0xedd53ca6b6e477e5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e477ec expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.530399:0:23375:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.156@tcp lock: ffff949f43a18400/0xedd53ca6b6e477e5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xedd53ca6b6e477ec expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136190.530496:0:23375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f442692c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23375:1876044587229056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789136190.530557:0:23375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136190.531078:0:23375:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a0468d1cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789136190.531235:0:23371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587229056 00000100:00100000:1.0:1789136190.531256:0:23371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587229056 00000100:00100000:1.0:1789136190.531293:0:23371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789136190.531301:0:23371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a049032050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+23:23375:x1876044587229056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789136190.531450:0:23371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a049032050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+23:23375:x1876044587229056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 149us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136190.531458:0:23371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789136190.531555:0:23375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f442692c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23375:1876044587229056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789136190.531885:0:23375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f442692c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23375:1876044587229184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789136190.531938:0:23375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136190.531969:0:23375:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a0468d1cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789136190.532023:0:23371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587229184 00000100:00100000:1.0:1789136190.532028:0:23371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587229184 00000100:00100000:1.0:1789136190.532052:0:23371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789136190.532058:0:23371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a049033450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+23:23375:x1876044587229184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789136190.532175:0:23371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a049033450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+23:23375:x1876044587229184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 117us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136190.532183:0:23371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789136190.532503:0:23375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f442692c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23375:1876044587229184:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789136190.534264:0:26435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 19 00000020:01000000:1.0:1789136190.534619:0:23375:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 19-18 (rc=0) 10000000:01000000:1.0:1789136190.534670:0:23375:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789136190.534695:0:23375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.156@tcp lock: ffff949f43a18400/0xedd53ca6b6e477e5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e477ec expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136190.534708:0:23375:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.156@tcp lock: ffff949f43a18400/0xedd53ca6b6e477e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e477ec expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789136190.534720:0:23375:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789136190.534724:0:23375:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff949f449ce800 from 19 10000000:01000000:1.0:1789136190.534727:0:23375:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789136190.534774:0:23375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a060036800/0xedd53ca6b6e477f3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136190.534783:0:23375:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.156@tcp lock: ffff94a060036800/0xedd53ca6b6e477f3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136190.534814:0:23375:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.156@tcp lock: ffff94a060036800/0xedd53ca6b6e477f3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136190.534843:0:23375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a0557212c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23375:1876044587229312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789136190.534928:0:23375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136190.534973:0:23375:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a050a30300 going to sleep for 11 seconds 00000100:00100000:0.0:1789136190.535487:0:23371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587229312 00000100:00100000:0.0:1789136190.535497:0:23371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587229312 00000100:00100000:0.0:1789136190.535586:0:23371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789136190.535598:0:23371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a049030450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+23:23375:x1876044587229312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789136190.535615:0:23371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136190.535661:0:23371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff949f43a19e00/0xedd53ca6b6e477fa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xedd53ca6b6e477f3 expref: -99 pid: 23371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.535702:0:23371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff949f43a19e00/0xedd53ca6b6e477fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedd53ca6b6e477f3 expref: 24 pid: 23371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.535715:0:23371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff949f43a19e00/0xedd53ca6b6e477fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedd53ca6b6e477f3 expref: 24 pid: 23371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.535725:0:23371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff949f43a19e00, rc 0) 00000100:00100000:0.0:1789136190.535795:0:23371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a049030450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+24:23375:x1876044587229312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 199us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136190.535804:0:23371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789136190.536374:0:23375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a0557212c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23375:1876044587229312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789136190.536397:0:23375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.156@tcp lock: ffff94a060036800/0xedd53ca6b6e477f3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e477fa expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136190.536408:0:23375:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.156@tcp lock: ffff94a060036800/0xedd53ca6b6e477f3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xedd53ca6b6e477fa expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136190.536498:0:23375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a0557212c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23375:1876044587229440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789136190.536558:0:23375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136190.536805:0:23375:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a050a30300 going to sleep for 11 seconds 00000100:00100000:1.0:1789136190.536827:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587229440 00000100:00100000:1.0:1789136190.536832:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587229440 00000100:00100000:1.0:1789136190.536862:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789136190.536870:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a049032850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+24:23375:x1876044587229440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789136190.537004:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a049032850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+24:23375:x1876044587229440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 134us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136190.537011:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789136190.537045:0:23375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a0557212c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23375:1876044587229440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789136190.537074:0:23375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a0557212c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23375:1876044587229568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789136190.537215:0:23375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136190.537231:0:23375:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a050a30300 going to sleep for 11 seconds 00000100:00100000:1.0:1789136190.537242:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587229568 00000100:00100000:1.0:1789136190.537246:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587229568 00000100:00100000:1.0:1789136190.537264:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789136190.537269:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f43751c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+24:23375:x1876044587229568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789136190.537349:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f43751c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+24:23375:x1876044587229568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136190.537355:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789136190.537395:0:23375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a0557212c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3644072c-bb98-4fbe-9eaf-e40d57d161d0:23375:1876044587229568:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789136190.539450:0:26436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 19 00000020:01000000:0.0:1789136190.540023:0:23375:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 19-18 (rc=0) 10000000:01000000:0.0:1789136190.540055:0:23375:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789136190.540069:0:23375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.156@tcp lock: ffff94a060036800/0xedd53ca6b6e477f3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e477fa expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.540081:0:23375:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.156@tcp lock: ffff94a060036800/0xedd53ca6b6e477f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xedd53ca6b6e477fa expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136190.632474:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:2.0:1789136190.633564:0:23378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567185408 00000100:00100000:2.0:1789136190.633575:0:23378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567185408 00000100:00100000:2.0:1789136190.633708:0:23378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 39 00000100:00100000:2.0:1789136190.633719:0:23378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a04373ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8be90b6-0a63-4a05-9b5e-0fab1488262f+17:18993:x1876044567185408:12345-192.168.206.56@tcp:101:lfs.0 00010000:00010000:2.0:1789136190.633743:0:23378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789136190.633772:0:23378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8200/0xedd53ca6b6e47801 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19d4d74b7ccf4a18 expref: -99 pid: 23378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789136190.633861:0:23378:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789136190.633958:0:23378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8200/0xedd53ca6b6e47801 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a18 expref: 19 pid: 23378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.633972:0:23378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff949f428ff000) 00010000:00010000:2.0:1789136190.633975:0:23378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789136190.633980:0:23378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8200/0xedd53ca6b6e47801 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a18 expref: 19 pid: 23378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136190.633995:0:23378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94a0773e8200, rc 0) 00000100:00100000:2.0:1789136190.634076:0:23378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a04373ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8be90b6-0a63-4a05-9b5e-0fab1488262f+18:18993:x1876044567185408:12345-192.168.206.56@tcp:101:lfs.0 Request processed in 358us (1611us total) trans 12884901898 rc 301/301 00000100:00100000:2.0:1789136190.634096:0:23378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 39 00000100:00100000:1.0:1789136190.643802:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:0.0:1789136190.643903:0:23381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567185664 00000100:00100000:0.0:1789136190.643912:0:23381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567185664 00000100:00100000:0.0:1789136190.644018:0:23381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 6 00000100:00100000:0.0:1789136190.644029:0:23381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0557212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d8be90b6-0a63-4a05-9b5e-0fab1488262f+18:18993:x1876044567185664:12345-192.168.206.56@tcp:35:lfs.0 00000100:00100000:0.0:1789136190.644253:0:23381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0557212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d8be90b6-0a63-4a05-9b5e-0fab1488262f+19:18993:x1876044567185664:12345-192.168.206.56@tcp:35:lfs.0 Request processed in 226us (460us total) trans 12884901899 rc 0/0 00000100:00100000:0.0:1789136190.644260:0:23381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 6 00000100:00100000:1.0:1789136190.689884:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:0.0:1789136190.690228:0:26186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567185920 00000100:00100000:0.0:1789136190.690249:0:26186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567185920 00000100:00100000:0.0:1789136190.690323:0:26186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 40 00000100:00100000:0.0:1789136190.690333:0:26186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a055723840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d8be90b6-0a63-4a05-9b5e-0fab1488262f+19:18996:x1876044567185920:12345-192.168.206.56@tcp:101:lfs.0 00010000:00010000:0.0:1789136190.690356:0:26186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136190.690376:0:26186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18c00/0xedd53ca6b6e4780f lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19d4d74b7ccf4a1f expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.690493:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18200/0xedd53ca6b6e47816 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.690507:0:26186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18200/0xedd53ca6b6e47816 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.690518:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18200/0xedd53ca6b6e47816 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789136190.690527:0:26186:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789136190.690652:0:26186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18c00/0xedd53ca6b6e4780f lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a1f expref: 22 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.690671:0:26186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18200/0xedd53ca6b6e47816 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a1f expref: 21 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.690680:0:26186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff949f428ff400) 00010000:00010000:0.0:1789136190.690693:0:26186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789136190.690698:0:26186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff949f43a18200, rc 0) 00000100:00100000:0.0:1789136190.690760:0:26186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a055723840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d8be90b6-0a63-4a05-9b5e-0fab1488262f+21:18996:x1876044567185920:12345-192.168.206.56@tcp:101:lfs.0 Request processed in 429us (885us total) trans 12884901900 rc 0/0 00000100:00100000:0.0:1789136190.690768:0:26186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 40 00000100:00100000:2.0:1789136190.693892:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:1.0:1789136190.693980:0:23363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567186048 00000100:00100000:1.0:1789136190.693989:0:23363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567186048 00000100:00100000:1.0:1789136190.694049:0:23363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 0 00000100:00100000:1.0:1789136190.694058:0:23363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a07f6e9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d8be90b6-0a63-4a05-9b5e-0fab1488262f+21:2397:x1876044567186048:12345-192.168.206.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789136190.694072:0:23363:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789136190.694094:0:23363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18200/0xedd53ca6b6e47816 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a1f expref: 21 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136190.694113:0:23363:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff949f428ff400) 00010000:00010000:1.0:1789136190.694118:0:23363:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789136190.694187:0:23363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a07f6e9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d8be90b6-0a63-4a05-9b5e-0fab1488262f+20:2397:x1876044567186048:12345-192.168.206.56@tcp:103:ldlm_bl.0 Request processed in 130us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136190.694194:0:23363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 0 00000100:00100000:2.0:1789136190.694575:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:0.0:1789136190.695403:0:23379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567186176 00000100:00100000:0.0:1789136190.695412:0:23379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567186176 00000100:00100000:0.0:1789136190.695601:0:23379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 41 00000100:00100000:0.0:1789136190.695612:0:23379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a07f6e8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8be90b6-0a63-4a05-9b5e-0fab1488262f+20:18996:x1876044567186176:12345-192.168.206.56@tcp:54:lfs.0 00010000:00010000:0.0:1789136190.695706:0:23379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19000/0xedd53ca6b6e47824 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.695721:0:23379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19000/0xedd53ca6b6e47824 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.695731:0:23379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19000/0xedd53ca6b6e47824 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.695762:0:23379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19000/0xedd53ca6b6e47824 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.695769:0:23379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19000/0xedd53ca6b6e47824 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.695775:0:23379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19000/0xedd53ca6b6e47824 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.695780:0:23379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff949f43a19000 already unused, calling callback (ffffffffc19d34f0) 00010000:00010000:0.0:1789136190.695784:0:23379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19000/0xedd53ca6b6e47824 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.695791:0:23379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19000/0xedd53ca6b6e47824 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.695800:0:23379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff949f428ff400) 00010000:00010000:0.0:1789136190.695803:0:23379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789136190.695817:0:23379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19000/0xedd53ca6b6e47824 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136190.695823:0:23379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19000/0xedd53ca6b6e47824 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136190.695872:0:23379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a07f6e8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8be90b6-0a63-4a05-9b5e-0fab1488262f+20:18996:x1876044567186176:12345-192.168.206.56@tcp:54:lfs.0 Request processed in 264us (1298us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136190.695879:0:23379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 41 00000100:00100000:2.0:1789136190.701671:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:3.0:1789136190.701924:0:23382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567186432 00000100:00100000:3.0:1789136190.701948:0:23382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567186432 00000100:00100000:3.0:1789136190.702043:0:23382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 7 00000100:00100000:3.0:1789136190.702053:0:23382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a07f6eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d8be90b6-0a63-4a05-9b5e-0fab1488262f+20:18996:x1876044567186432:12345-192.168.206.56@tcp:35:lfs.0 00000100:00100000:3.0:1789136190.702301:0:23382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a07f6eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d8be90b6-0a63-4a05-9b5e-0fab1488262f+21:18996:x1876044567186432:12345-192.168.206.56@tcp:35:lfs.0 Request processed in 238us (670us total) trans 12884901901 rc 0/0 00000100:00100000:3.0:1789136190.702310:0:23382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 7 00010000:00010000:3.0:1789136190.773245:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789136191.074376:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:1.0:1789136191.074582:0:23378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567186688 00000100:00100000:1.0:1789136191.074594:0:23378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567186688 00000100:00100000:1.0:1789136191.074707:0:23378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 42 00000100:00100000:1.0:1789136191.074719:0:23378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a07ad9ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8be90b6-0a63-4a05-9b5e-0fab1488262f+21:19027:x1876044567186688:12345-192.168.206.56@tcp:101:cat.0 00010000:00010000:1.0:1789136191.074752:0:23378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789136191.074788:0:23378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94a060037a00/0xedd53ca6b6e4782b lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19d4d74b7ccf4a26 expref: -99 pid: 23378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136191.074947:0:23378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94a060036600/0xedd53ca6b6e47832 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136191.074964:0:23378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94a060036600/0xedd53ca6b6e47832 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136191.074981:0:23378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94a060036600/0xedd53ca6b6e47832 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789136191.074995:0:23378:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789136191.075184:0:23378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94a060037a00/0xedd53ca6b6e4782b lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a26 expref: 24 pid: 23378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136191.075209:0:23378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94a060036600/0xedd53ca6b6e47832 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a26 expref: 23 pid: 23378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136191.075219:0:23378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff949f428ff400) 00010000:00010000:1.0:1789136191.075223:0:23378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789136191.075227:0:23378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94a060036600, rc 0) 00000100:00100000:1.0:1789136191.075315:0:23378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a07ad9ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8be90b6-0a63-4a05-9b5e-0fab1488262f+23:19027:x1876044567186688:12345-192.168.206.56@tcp:101:cat.0 Request processed in 598us (955us total) trans 12884901902 rc 0/0 00000100:00100000:1.0:1789136191.075344:0:23378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 42 00000100:00100000:3.0:1789136191.084713:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:3.0:1789136191.084833:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:1.0:1789136191.086419:0:23364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567186816 00000100:00100000:1.0:1789136191.086446:0:23364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567186816 00000100:00100000:1.0:1789136191.086555:0:23364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 1 00000100:00100000:1.0:1789136191.086568:0:23364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a04373cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d8be90b6-0a63-4a05-9b5e-0fab1488262f+23:2398:x1876044567186816:12345-192.168.206.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789136191.086588:0:23364:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789136191.086663:0:23364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94a060036600/0xedd53ca6b6e47832 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a26 expref: 23 pid: 23378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136191.086689:0:23364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff949f428ff400) 00010000:00010000:1.0:1789136191.086695:0:23364:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789136191.086780:0:23364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a04373cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d8be90b6-0a63-4a05-9b5e-0fab1488262f+22:2398:x1876044567186816:12345-192.168.206.56@tcp:103:ldlm_bl.0 Request processed in 215us (1946us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136191.086789:0:23364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 1 00000100:00100000:2.0:1789136191.093619:0:23382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567187072 00000100:00100000:2.0:1789136191.093669:0:23382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567187072 00000100:00100000:2.0:1789136191.093769:0:23382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 8 00000100:00100000:2.0:1789136191.093783:0:23382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a04373de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d8be90b6-0a63-4a05-9b5e-0fab1488262f+22:19027:x1876044567187072:12345-192.168.206.56@tcp:35:cat.0 00000100:00100000:2.0:1789136191.094233:0:23382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a04373de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d8be90b6-0a63-4a05-9b5e-0fab1488262f+23:19027:x1876044567187072:12345-192.168.206.56@tcp:35:cat.0 Request processed in 452us (9534us total) trans 12884901903 rc 0/0 00000100:00100000:2.0:1789136191.094243:0:23382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 8 00000040:00080000:1.0:1789136191.153389:0:23417:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789136191.189099:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:2.0:1789136191.191923:0:23380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567187328 00000100:00100000:2.0:1789136191.191939:0:23380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567187328 00000100:00100000:2.0:1789136191.192028:0:23380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 43 00000100:00100000:2.0:1789136191.192040:0:23380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a04373c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8be90b6-0a63-4a05-9b5e-0fab1488262f+23:19033:x1876044567187328:12345-192.168.206.56@tcp:101:dd.0 00010000:00010000:2.0:1789136191.192065:0:23380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789136191.192086:0:23380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8400/0xedd53ca6b6e47840 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19d4d74b7ccf4a2d expref: -99 pid: 23380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136191.192714:0:23380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8000/0xedd53ca6b6e47847 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136191.192730:0:23380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8000/0xedd53ca6b6e47847 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136191.192741:0:23380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8000/0xedd53ca6b6e47847 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23380 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789136191.192767:0:23380:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789136191.192966:0:23380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8400/0xedd53ca6b6e47840 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a2d expref: 26 pid: 23380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136191.193059:0:23380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8000/0xedd53ca6b6e47847 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a2d expref: 25 pid: 23380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136191.193068:0:23380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff949f428ff400) 00010000:00010000:2.0:1789136191.193071:0:23380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789136191.193074:0:23380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94a0773e8000, rc 0) 00000100:00100000:2.0:1789136191.193267:0:23380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a04373c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8be90b6-0a63-4a05-9b5e-0fab1488262f+25:19033:x1876044567187328:12345-192.168.206.56@tcp:101:dd.0 Request processed in 1227us (4175us total) trans 12884901904 rc 0/0 00000100:00100000:2.0:1789136191.193275:0:23380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 43 00000100:00100000:1.0:1789136191.200564:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:1.0:1789136191.200611:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:0.0:1789136191.200797:0:23379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567187456 00000100:00100000:0.0:1789136191.200806:0:23379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567187456 00000100:00100000:0.0:1789136191.200878:0:23379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 44 00000100:00100000:0.0:1789136191.200888:0:23379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f429f8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8be90b6-0a63-4a05-9b5e-0fab1488262f+25:19033:x1876044567187456:12345-192.168.206.56@tcp:101:dd.0 00010000:00010000:0.0:1789136191.200912:0:23379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136191.200934:0:23379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19000/0xedd53ca6b6e47855 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19d4d74b7ccf4a34 expref: -99 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136191.200969:0:23379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18c00/0xedd53ca6b6e4785c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136191.200995:0:23379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18c00/0xedd53ca6b6e4785c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136191.201006:0:23379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18c00/0xedd53ca6b6e4785c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136191.201138:0:23379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19000/0xedd53ca6b6e47855 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a34 expref: 27 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136191.201156:0:23379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18c00/0xedd53ca6b6e4785c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a34 expref: 26 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136191.201171:0:23379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff949f428ff400) 00010000:00010000:0.0:1789136191.201174:0:23379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789136191.201177:0:23379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff949f43a18c00, rc 0) 00000100:00100000:3.0:1789136191.201415:0:23365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567187584 00000100:00100000:3.0:1789136191.201420:0:23365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567187584 00000100:00100000:3.0:1789136191.201474:0:23365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 2 00000100:00100000:3.0:1789136191.201482:0:23365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f429f92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d8be90b6-0a63-4a05-9b5e-0fab1488262f+27:2397:x1876044567187584:12345-192.168.206.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789136191.201500:0:23365:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789136191.201515:0:23365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8000/0xedd53ca6b6e47847 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a2d expref: 27 pid: 23380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136191.201528:0:23365:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff949f428ff400) 00010000:00010000:3.0:1789136191.201532:0:23365:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789136191.202302:0:23379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f429f8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8be90b6-0a63-4a05-9b5e-0fab1488262f+26:19033:x1876044567187456:12345-192.168.206.56@tcp:101:dd.0 Request processed in 1411us (1741us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136191.202311:0:23379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 44 00000100:00100000:3.0:1789136191.205525:0:23365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f429f92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d8be90b6-0a63-4a05-9b5e-0fab1488262f+25:2397:x1876044567187584:12345-192.168.206.56@tcp:103:ldlm_bl.0 Request processed in 4032us (4901us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136191.205540:0:23365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 2 00000100:00100000:1.0:1789136191.208088:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:2.0:1789136191.208266:0:23378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567187840 00000100:00100000:2.0:1789136191.208276:0:23378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567187840 00000100:00100000:2.0:1789136191.208438:0:23378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 45 00000100:00100000:2.0:1789136191.208452:0:23378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f429fb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8be90b6-0a63-4a05-9b5e-0fab1488262f+25:19033:x1876044567187840:12345-192.168.206.56@tcp:36:dd.0 00010000:00010000:2.0:1789136191.208506:0:23378:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789136191.208533:0:23378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19a00/0xedd53ca6b6e477c9 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a11 expref: 25 pid: 23380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136191.208553:0:23378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff949f428ff400) 00010000:00010000:2.0:1789136191.208558:0:23378:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789136191.209076:0:23378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9200/0xedd53ca6b6e47863 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136191.209090:0:23378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9200/0xedd53ca6b6e47863 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136191.209358:0:23378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9200/0xedd53ca6b6e47863 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789136191.209415:0:23378:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:2.0:1789136191.209452:0:23378:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000ad4016c3 reply state 000000009b738504 transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9200/0xedd53ca6b6e47863 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136191.209464:0:23378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9200/0xedd53ca6b6e47863 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136191.209471:0:23378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff949f428ff400) 00010000:00010000:2.0:1789136191.209474:0:23378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789136191.209477:0:23378:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789136191.209618:0:23378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f429fb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8be90b6-0a63-4a05-9b5e-0fab1488262f+27:19033:x1876044567187840:12345-192.168.206.56@tcp:36:dd.0 Request processed in 1168us (1538us total) trans 12884901906 rc 0/0 00000100:00100000:2.0:1789136191.209655:0:23378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 45 00000020:00080000:2.0:1789136191.209662:0:23378:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789136191.320409:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:3.0:1789136191.320671:0:23381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567188096 00000100:00100000:3.0:1789136191.320681:0:23381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567188096 00000100:00100000:3.0:1789136191.320738:0:23381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 9 00000100:00100000:3.0:1789136191.320749:0:23381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f42b1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d8be90b6-0a63-4a05-9b5e-0fab1488262f+27:19033:x1876044567188096:12345-192.168.206.56@tcp:35:dd.0 00000100:00100000:3.0:1789136191.321019:0:23381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f42b1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d8be90b6-0a63-4a05-9b5e-0fab1488262f+28:19033:x1876044567188096:12345-192.168.206.56@tcp:35:dd.0 Request processed in 271us (619us total) trans 12884901907 rc 0/0 00000100:00100000:3.0:1789136191.321028:0:23381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 9 00000100:00100000:2.0:1789136191.473375:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789136191.473401:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f429f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876044587229696:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789136191.473467:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136191.473554:0:23384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587229696 00000100:00100000:1.0:1789136191.473562:0:23384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587229696 00000100:00100000:1.0:1789136191.473619:0:23384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789136191.473655:0:23384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f440a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876044587229696:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789136191.473687:0:23384:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789136191.473733:0:23384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f440a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876044587229696:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136191.473741:0:23384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789136191.474302:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789136191.474315:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f442692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876044587229824:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789136191.474348:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136191.474431:0:24123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587229824 00000100:00100000:2.0:1789136191.474436:0:24123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587229824 00000100:00100000:2.0:1789136191.474471:0:24123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789136191.474479:0:24123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f429f9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876044587229824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789136191.474499:0:24123:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789136191.474538:0:24123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f429f9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876044587229824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 60us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136191.474555:0:24123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789136191.474623:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f442692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876044587229824:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789136191.474680:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f429f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876044587229696:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789136191.474807:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f440a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876044587229952:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789136191.474840:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136191.477327:0:24896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587229952 00000100:00100000:2.0:1789136191.477339:0:24896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587229952 00000100:00100000:2.0:1789136191.477410:0:24896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789136191.477422:0:24896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f442692c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876044587229952:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789136191.477455:0:24896:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915845632 avail 3684323328 00000100:00100000:2.0:1789136191.477544:0:24896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f442692c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876044587229952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 125us (2703us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136191.477550:0:24896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1789136191.477662:0:23374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789136191.477909:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f440a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876044587229952:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789136191.636227:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:2.0:1789136191.636289:0:23380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567188224 00000100:00100000:2.0:1789136191.636299:0:23380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567188224 00000100:00100000:2.0:1789136191.636388:0:23380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 46 00000100:00100000:2.0:1789136191.636399:0:23380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a04373da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8be90b6-0a63-4a05-9b5e-0fab1488262f+28:19047:x1876044567188224:12345-192.168.206.56@tcp:101:stat.0 00010000:00010000:2.0:1789136191.636421:0:23380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789136191.636451:0:23380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9000/0xedd53ca6b6e4786a lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19d4d74b7ccf4a3b expref: -99 pid: 23380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136191.636517:0:23380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9400/0xedd53ca6b6e47871 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136191.636532:0:23380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9400/0xedd53ca6b6e47871 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136191.636542:0:23380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9400/0xedd53ca6b6e47871 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136191.636567:0:23380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8600/0xedd53ca6b6e47878 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136191.636575:0:23380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8600/0xedd53ca6b6e47878 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136191.636582:0:23380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8600/0xedd53ca6b6e47878 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136191.636689:0:23380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9a00/0xedd53ca6b6e4787f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136191.636698:0:23380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9a00/0xedd53ca6b6e4787f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136191.636705:0:23380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9a00/0xedd53ca6b6e4787f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23380 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789136191.636743:0:23380:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789136191.636748:0:23380:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789136191.636799:0:23380:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9a00/0xedd53ca6b6e4787f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136191.636810:0:23380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9a00/0xedd53ca6b6e4787f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136191.636817:0:23380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9400/0xedd53ca6b6e47871 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136191.636824:0:23380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9400/0xedd53ca6b6e47871 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 23380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136191.636842:0:23380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9400/0xedd53ca6b6e47871 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136191.636847:0:23380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a0773e9400 already unused, calling callback (ffffffffc19d34f0) 00010000:00010000:2.0:1789136191.636851:0:23380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9400/0xedd53ca6b6e47871 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136191.636859:0:23380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9400/0xedd53ca6b6e47871 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 23380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136191.636871:0:23380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff94a0490dfd00) 00010000:00010000:2.0:1789136191.636874:0:23380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789136191.636878:0:23380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9400/0xedd53ca6b6e47871 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136191.636884:0:23380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9400/0xedd53ca6b6e47871 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136191.636897:0:23380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8600/0xedd53ca6b6e47878 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136191.636902:0:23380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8600/0xedd53ca6b6e47878 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136191.636907:0:23380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8600/0xedd53ca6b6e47878 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136191.636911:0:23380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a0773e8600 already unused, calling callback (ffffffffc19d34f0) 00010000:00010000:2.0:1789136191.636914:0:23380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8600/0xedd53ca6b6e47878 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136191.636930:0:23380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8600/0xedd53ca6b6e47878 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136191.636938:0:23380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff949f428ffb00) 00010000:00010000:2.0:1789136191.636941:0:23380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789136191.636943:0:23380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8600/0xedd53ca6b6e47878 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136191.636950:0:23380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8600/0xedd53ca6b6e47878 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136191.636975:0:23380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9000/0xedd53ca6b6e4786a lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a3b expref: 30 pid: 23380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136191.636989:0:23380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9a00/0xedd53ca6b6e4787f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a3b expref: 29 pid: 23380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136191.636996:0:23380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff949f428ff400) 00010000:00010000:2.0:1789136191.636999:0:23380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789136191.637001:0:23380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94a0773e9a00, rc 0) 00000100:00100000:2.0:1789136191.637064:0:23380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a04373da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8be90b6-0a63-4a05-9b5e-0fab1488262f+29:19047:x1876044567188224:12345-192.168.206.56@tcp:101:stat.0 Request processed in 667us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136191.637072:0:23380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 46 00000100:00100000:1.0:1789136191.725296:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:0.0:1789136191.725392:0:23379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567188480 00000100:00100000:0.0:1789136191.725402:0:23379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567188480 00000100:00100000:0.0:1789136191.725476:0:23379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 47 00000100:00100000:0.0:1789136191.725487:0:23379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f429f8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8be90b6-0a63-4a05-9b5e-0fab1488262f+29:19053:x1876044567188480:12345-192.168.206.56@tcp:36:truncate.0 00010000:00010000:0.0:1789136191.725545:0:23379:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789136191.725573:0:23379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9a00/0xedd53ca6b6e4787f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a3b expref: 29 pid: 23380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136191.725592:0:23379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff949f428ff400) 00010000:00010000:0.0:1789136191.725597:0:23379:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789136191.726262:0:23379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18a00/0xedd53ca6b6e47886 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136191.726278:0:23379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18a00/0xedd53ca6b6e47886 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136191.726288:0:23379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18a00/0xedd53ca6b6e47886 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789136191.726352:0:23379:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901908 00000004:00010000:0.0:1789136191.726376:0:23379:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000544f9e7a reply state 000000001071d54f transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18a00/0xedd53ca6b6e47886 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136191.726388:0:23379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18a00/0xedd53ca6b6e47886 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136191.726395:0:23379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff949f428ff400) 00010000:00010000:0.0:1789136191.726397:0:23379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789136191.726400:0:23379:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789136191.726810:0:23379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f429f8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8be90b6-0a63-4a05-9b5e-0fab1488262f+31:19053:x1876044567188480:12345-192.168.206.56@tcp:36:truncate.0 Request processed in 1323us (1521us total) trans 12884901909 rc 0/0 00000100:00100000:0.0:1789136191.726819:0:23379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 47 00000020:00080000:0.0:1789136191.726825:0:23379:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789136191.793413:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136191.940380:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:2.0:1789136191.940738:0:23378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567188608 00000100:00100000:2.0:1789136191.940748:0:23378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567188608 00000100:00100000:2.0:1789136191.940921:0:23378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 48 00000100:00100000:2.0:1789136191.940932:0:23378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a04373fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8be90b6-0a63-4a05-9b5e-0fab1488262f+31:19067:x1876044567188608:12345-192.168.206.56@tcp:101:stat.0 00010000:00010000:2.0:1789136191.940969:0:23378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789136191.940990:0:23378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9000/0xedd53ca6b6e4788d lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19d4d74b7ccf4a42 expref: -99 pid: 23378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136191.941064:0:23378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8600/0xedd53ca6b6e47894 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136191.941078:0:23378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8600/0xedd53ca6b6e47894 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136191.941090:0:23378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8600/0xedd53ca6b6e47894 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136191.941100:0:23378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9400/0xedd53ca6b6e4789b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136191.941106:0:23378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9400/0xedd53ca6b6e4789b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136191.941490:0:23378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9400/0xedd53ca6b6e4789b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136191.941562:0:23378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9e00/0xedd53ca6b6e478a2 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136191.941572:0:23378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9e00/0xedd53ca6b6e478a2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136191.941578:0:23378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9e00/0xedd53ca6b6e478a2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789136191.941616:0:23378:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00000004:00200000:2.0:1789136191.941660:0:23378:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789136191.941684:0:23378:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9e00/0xedd53ca6b6e478a2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136191.941695:0:23378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9e00/0xedd53ca6b6e478a2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136191.941704:0:23378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8600/0xedd53ca6b6e47894 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136191.941710:0:23378:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8600/0xedd53ca6b6e47894 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136191.941716:0:23378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8600/0xedd53ca6b6e47894 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136191.941722:0:23378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a0773e8600 already unused, calling callback (ffffffffc19d34f0) 00010000:00010000:2.0:1789136191.941727:0:23378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8600/0xedd53ca6b6e47894 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136191.941735:0:23378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8600/0xedd53ca6b6e47894 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136191.941746:0:23378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff94a0490dfd00) 00010000:00010000:2.0:1789136191.941749:0:23378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789136191.941754:0:23378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8600/0xedd53ca6b6e47894 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136191.941761:0:23378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8600/0xedd53ca6b6e47894 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136191.941775:0:23378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9400/0xedd53ca6b6e4789b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136191.941790:0:23378:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9400/0xedd53ca6b6e4789b lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136191.941796:0:23378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9400/0xedd53ca6b6e4789b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136191.941801:0:23378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a0773e9400 already unused, calling callback (ffffffffc19d34f0) 00010000:00010000:2.0:1789136191.941917:0:23378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9400/0xedd53ca6b6e4789b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136191.941926:0:23378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9400/0xedd53ca6b6e4789b lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136191.941935:0:23378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff949f428ffb00) 00010000:00010000:2.0:1789136191.941938:0:23378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789136191.941941:0:23378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9400/0xedd53ca6b6e4789b lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136191.941946:0:23378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9400/0xedd53ca6b6e4789b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136191.941977:0:23378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9000/0xedd53ca6b6e4788d lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a42 expref: 33 pid: 23378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136191.941992:0:23378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9e00/0xedd53ca6b6e478a2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a42 expref: 32 pid: 23378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136191.942055:0:23378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff949f428ff400) 00010000:00010000:2.0:1789136191.942057:0:23378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789136191.942066:0:23378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94a0773e9e00, rc 0) 00000100:00100000:2.0:1789136191.942257:0:23378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a04373fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8be90b6-0a63-4a05-9b5e-0fab1488262f+32:19067:x1876044567188608:12345-192.168.206.56@tcp:101:stat.0 Request processed in 1325us (1887us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136191.942265:0:23378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 48 00000100:00100000:3.0:1789136191.985337:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a04373cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876044587230208:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789136191.985401:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136191.985458:0:24896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587230208 00000100:00100000:3.0:1789136191.985464:0:24896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587230208 00000100:00100000:3.0:1789136191.985514:0:24896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789136191.985523:0:24896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a04373c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876044587230208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789136191.985544:0:24896:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915845632 avail 3684323328 00000100:00100000:3.0:1789136191.985595:0:24896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a04373c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876044587230208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136191.985602:0:24896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:3.0:1789136191.985624:0:23374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789136191.985678:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a04373cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876044587230208:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789136191.986339:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f440a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876044587230336:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789136191.986374:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136191.986460:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f440a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876044587230080:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789136191.986495:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4426bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3644072c-bb98-4fbe-9eaf-e40d57d161d0:3645:1876044587230464:0@lo:400:kworker.0 00000100:00100000:1.0:1789136191.986523:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136191.986563:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4416e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876044587230976:0@lo:400:kworker.0 00000100:00100000:1.0:1789136191.986589:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136191.986601:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587230464 00000100:00100000:0.0:1789136191.986606:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587230464 00000100:00100000:1.0:1789136191.986607:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a0556fbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876044587231488:0@lo:400:kworker.0 00000100:00100000:1.0:1789136191.986652:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136191.986657:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789136191.986665:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0769c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+24:3645:x1876044587230464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136191.986683:0:24123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587230976 00000100:00100000:1.0:1789136191.986687:0:24123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587230976 00000100:00100000:1.0:1789136191.986714:0:24123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789136191.986720:0:24123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f429f8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876044587230976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136191.986731:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0769c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3644072c-bb98-4fbe-9eaf-e40d57d161d0+24:3645:x1876044587230464:12345-0@lo:400:kworker.0 Request processed in 67us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136191.986737:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789136191.986751:0:24123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f429f8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876044587230976:12345-0@lo:400:kworker.0 Request processed in 32us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136191.986757:0:24123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789136191.986776:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4426bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3644072c-bb98-4fbe-9eaf-e40d57d161d0:3645:1876044587230464:0@lo:400:kworker.0 00000100:00100000:1.0:1789136191.986786:0:23380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587231488 00000100:00100000:0.0:1789136191.986786:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4416e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876044587230976:0@lo:400:kworker.0 00000100:00100000:1.0:1789136191.986789:0:23380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587231488 00000100:00100000:1.0:1789136191.986869:0:23380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789136191.986875:0:23380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f429fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876044587231488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136191.986906:0:23380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f429fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876044587231488:12345-0@lo:400:kworker.0 Request processed in 32us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136191.986926:0:23380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789136191.992078:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4426ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876044587230720:0@lo:400:kworker.0 00000100:00100000:2.0:1789136191.994252:0:24896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587230336 00000100:00100000:2.0:1789136191.994265:0:24896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587230336 00000100:00100000:2.0:1789136191.994337:0:24896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789136191.994348:0:24896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a04373cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876044587230336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789136191.994378:0:24896:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1789136191.994452:0:24896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a04373cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876044587230336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (8077us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136191.994459:0:24896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1789136191.994502:0:23374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789136191.994507:0:23374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789136191.995662:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a0556fbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876044587231488:0@lo:400:kworker.0 00000100:00100000:3.0:1789136191.996186:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f440a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876044587230336:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789136191.996198:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f44268780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876044587230848:0@lo:400:kworker.0 00000100:00100000:3.0:1789136191.996248:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136191.996277:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a0556f92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876044587231360:0@lo:400:kworker.0 00000100:00100000:3.0:1789136191.996320:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136191.996348:0:26186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587230848 00000100:00100000:3.0:1789136191.996354:0:26186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587230848 00000100:00100000:3.0:1789136191.996388:0:26186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587231360 00000100:00100000:3.0:1789136191.996391:0:26186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587231360 00000100:00100000:3.0:1789136191.996426:0:26186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789136191.996646:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136191.996653:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136191.996674:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f442683c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876044587230592:0@lo:400:kworker.0 00000100:00100000:0.0:1789136191.996674:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a0556fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876044587231232:0@lo:400:kworker.0 00000100:00100000:1.0:1789136191.996701:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136191.996719:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4402e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876044587231104:0@lo:400:kworker.0 00000100:00100000:1.0:1789136191.996742:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136191.996759:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a0556f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876044587231616:0@lo:400:kworker.0 00000100:00100000:0.0:1789136191.996774:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136191.996790:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136191.996936:0:26186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a04373f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876044587230848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136191.996955:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a0556f8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876044587231744:0@lo:400:kworker.0 00000100:00100000:0.0:1789136191.996980:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136191.996993:0:26186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a04373f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876044587230848:12345-0@lo:400:kworker.0 Request processed in 63us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136191.997113:0:23379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789136191.997133:0:23379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a04373e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876044587231360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136191.997168:0:23379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a04373e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876044587231360:12345-0@lo:400:kworker.0 Request processed in 47us (847us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136191.997174:0:23379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789136191.997193:0:23379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587231616 00000100:00100000:2.0:1789136191.997197:0:23379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587231616 00000100:00100000:2.0:1789136191.997223:0:23379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587231744 00000100:00100000:2.0:1789136191.997226:0:23379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587231744 00000100:00100000:2.0:1789136191.997240:0:23379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789136191.997246:0:23379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f429fbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876044587231616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136191.997281:0:23379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f429fbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876044587231616:12345-0@lo:400:kworker.0 Request processed in 35us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136191.997287:0:23379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789136191.997309:0:23379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789136191.997316:0:23379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0556f9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876044587231744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136191.997349:0:23379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0556f9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876044587231744:12345-0@lo:400:kworker.0 Request processed in 34us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136191.997355:0:23379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:2.0:1789136191.997372:0:23374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789136191.997375:0:23374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1789136191.997651:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94a0556f9680 x1876044587231616/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136207 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789136191.997663:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a0556f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876044587231616:0@lo:400:kworker.0 00000100:00100000:2.0:1789136191.997687:0:24896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587230080 00000100:00100000:2.0:1789136191.997691:0:24896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587230080 00000100:00100000:2.0:1789136191.997724:0:24896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789136191.997730:0:24896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f429fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876044587230080:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789136191.997743:0:24896:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1789136192.000212:0:24892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587230720 00000100:00100000:1.0:1789136192.000226:0:24892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587230720 00000100:00100000:0.0:1789136192.000268:0:24895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587231104 00000100:00100000:0.0:1789136192.000273:0:24895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587231104 00000100:00100000:1.0:1789136192.000283:0:24892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587231232 00000100:00100000:1.0:1789136192.000286:0:24892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587231232 00000100:00100000:2.0:1789136192.000385:0:24896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f429fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3646:x1876044587230080:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2653us (3737us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136192.000574:0:24896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789136192.000620:0:24892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789136192.000642:0:24895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789136192.000646:0:24892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0556f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876044587230720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136192.000650:0:24895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f429f9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876044587231104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136192.000697:0:24892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0556f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876044587230720:12345-0@lo:400:kworker.0 Request processed in 55us (4044us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136192.000704:0:24892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789136192.000716:0:24892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789136192.000723:0:24892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0556f9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876044587231232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136192.000751:0:24892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0556f9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876044587231232:12345-0@lo:400:kworker.0 Request processed in 29us (3976us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136192.000756:0:24895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f429f9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876044587231104:12345-0@lo:400:kworker.0 Request processed in 108us (4014us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136192.000757:0:24892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789136192.000762:0:24895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789136192.000901:0:23383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587230592 00000100:00100000:0.0:1789136192.000905:0:23383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587230592 00000100:00100000:0.0:1789136192.000936:0:23383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789136192.000942:0:23383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f429f83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876044587230592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136192.000979:0:23383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f429f83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876044587230592:12345-0@lo:400:kworker.0 Request processed in 37us (4277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136192.000984:0:23383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789136192.002963:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4426ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876044587230720:0@lo:400:kworker.0 00000100:00100000:1.0:1789136192.002992:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a0556fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876044587231232:0@lo:400:kworker.0 00000100:00100000:1.0:1789136192.003033:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a0556f8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876044587231744:0@lo:400:kworker.0 00000100:00100000:1.0:1789136192.003281:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f440a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876044587230080:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789136192.003293:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f442683c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876044587230592:0@lo:400:kworker.0 00000100:00100000:1.0:1789136192.003303:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4402e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876044587231104:0@lo:400:kworker.0 00000100:00080000:1.0:1789136192.003327:0:23374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789136192.003723:0:26186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789136192.003792:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a0556f92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876044587231360:0@lo:400:kworker.0 00000100:00100000:3.0:1789136192.003802:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a0556fa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1876044587231872:0@lo:400:kworker.0 00000100:00100000:3.0:1789136192.003865:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136192.003911:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f44268780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876044587230848:0@lo:400:kworker.0 00000100:00100000:0.0:1789136192.004944:0:23379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587231872 00000100:00100000:0.0:1789136192.004953:0:23379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587231872 00000100:00100000:0.0:1789136192.005208:0:23379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789136192.005219:0:23379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a04373f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1876044587231872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136192.005290:0:23379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a04373f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1876044587231872:12345-0@lo:400:kworker.0 Request processed in 73us (1424us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136192.005298:0:23379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:1.0:1789136192.005374:0:23374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1789136192.005987:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94a0556fa580 x1876044587231872/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136208 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136192.006193:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a0556fa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1876044587231872:0@lo:400:kworker.0 00000100:00100000:3.0:1789136192.058592:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:0.0:1789136192.058784:0:23380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567188864 00000100:00100000:0.0:1789136192.058793:0:23380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567188864 00000100:00100000:0.0:1789136192.058871:0:23380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 49 00000100:00100000:0.0:1789136192.058894:0:23380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a04373d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8be90b6-0a63-4a05-9b5e-0fab1488262f+32:19077:x1876044567188864:12345-192.168.206.56@tcp:101:lfs.0 00010000:00010000:0.0:1789136192.058914:0:23380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136192.058931:0:23380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19c00/0xedd53ca6b6e478a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19d4d74b7ccf4a49 expref: -99 pid: 23380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789136192.059156:0:23374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:0.0:1789136192.059216:0:23380:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789136192.059314:0:23380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19c00/0xedd53ca6b6e478a9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a49 expref: 34 pid: 23380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136192.059329:0:23380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff949f428ff000) 00010000:00010000:0.0:1789136192.059333:0:23380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789136192.059338:0:23380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19c00/0xedd53ca6b6e478a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a49 expref: 34 pid: 23380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136192.059363:0:23380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff949f43a19c00, rc 0) 00000100:00100000:0.0:1789136192.059414:0:23380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a04373d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8be90b6-0a63-4a05-9b5e-0fab1488262f+33:19077:x1876044567188864:12345-192.168.206.56@tcp:101:lfs.0 Request processed in 523us (832us total) trans 12884901910 rc 301/301 00000100:00100000:0.0:1789136192.059422:0:23380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 49 00000100:00100000:1.0:1789136192.067032:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:3.0:1789136192.067215:0:23381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567189120 00000100:00100000:3.0:1789136192.067226:0:23381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567189120 00000100:00100000:3.0:1789136192.067289:0:23381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 10 00000100:00100000:3.0:1789136192.067300:0:23381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f43b98850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d8be90b6-0a63-4a05-9b5e-0fab1488262f+33:19077:x1876044567189120:12345-192.168.206.56@tcp:35:lfs.0 00000100:00100000:3.0:1789136192.067533:0:23381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f43b98850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d8be90b6-0a63-4a05-9b5e-0fab1488262f+34:19077:x1876044567189120:12345-192.168.206.56@tcp:35:lfs.0 Request processed in 235us (509us total) trans 12884901911 rc 0/0 00000100:00100000:3.0:1789136192.067542:0:23381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 10 00000100:00100000:3.0:1789136192.154416:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:0.0:1789136192.154577:0:26186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567189376 00000100:00100000:0.0:1789136192.154588:0:26186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567189376 00000100:00100000:0.0:1789136192.154688:0:26186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 50 00000100:00100000:0.0:1789136192.154697:0:26186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a04373de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d8be90b6-0a63-4a05-9b5e-0fab1488262f+34:19083:x1876044567189376:12345-192.168.206.56@tcp:101:bash.0 00010000:00010000:0.0:1789136192.154719:0:26186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136192.154738:0:26186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18800/0xedd53ca6b6e478b7 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19d4d74b7ccf4a50 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136192.154859:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19c00/0xedd53ca6b6e478be lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136192.154887:0:26186:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18600/0xedd53ca6b6e477ad lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a0a expref: 35 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136192.154895:0:26186:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9e00/0xedd53ca6b6e478a2 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a42 expref: 35 pid: 23378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136192.154903:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19c00/0xedd53ca6b6e478be lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136192.154934:0:26186:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9e00/0xedd53ca6b6e478a2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a42 expref: 35 pid: 23378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136192.154947:0:26186:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9e00/0xedd53ca6b6e478a2 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a42 expref: 35 pid: 23378 timeout: 830 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136192.154960:0:26186:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a0556fb840 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:26186:1876044587232000:192.168.206.56@tcp:104: 00010000:00010000:0.0:1789136192.155246:0:26186:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18600/0xedd53ca6b6e477ad lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a0a expref: 35 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136192.155256:0:26186:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18600/0xedd53ca6b6e477ad lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a0a expref: 35 pid: 26186 timeout: 830 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136192.155265:0:26186:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a0556fb0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:26186:1876044587232128:192.168.206.56@tcp:104: 00000100:00100000:0.0:1789136192.155290:0:26186:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a081af1240 going to sleep for 11 seconds 00000100:00100000:3.0:1789136192.161753:0:26186:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a0556fb840 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:26186:1876044587232000:192.168.206.56@tcp:104: 00000100:00100000:3.0:1789136192.161824:0:26186:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a0556fb0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:26186:1876044587232128:192.168.206.56@tcp:104: 00010000:00010000:3.0:1789136192.161853:0:26186:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19c00/0xedd53ca6b6e478be lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136192.161880:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:2.0:1789136192.161920:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:1.0:1789136192.162215:0:23364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567189504 00000100:00100000:1.0:1789136192.162222:0:23364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567189504 00010000:00010000:1.0:1789136192.162260:0:23364:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9e00/0xedd53ca6b6e478a2 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a42 expref: 36 pid: 23378 timeout: 830 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136192.162292:0:23364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567189632 00000100:00100000:1.0:1789136192.162295:0:23364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567189632 00010000:00010000:1.0:1789136192.162308:0:23364:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18600/0xedd53ca6b6e477ad lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a0a expref: 37 pid: 26186 timeout: 830 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136192.162324:0:23364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 17 00000100:00100000:1.0:1789136192.162333:0:23364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a043c6f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d8be90b6-0a63-4a05-9b5e-0fab1488262f+37:2398:x1876044567189504:12345-192.168.206.56@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1789136192.162335:0:23365:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789136192.162344:0:23365:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1789136192.162350:0:23364:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789136192.162358:0:23364:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9e00/0xedd53ca6b6e478a2 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a42 expref: 37 pid: 23378 timeout: 830 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136192.162370:0:23364:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9e00/0xedd53ca6b6e478a2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a42 expref: 37 pid: 23378 timeout: 830 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136192.162415:0:23364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9e00/0xedd53ca6b6e478a2 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a42 expref: 37 pid: 23378 timeout: 830 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136192.162440:0:23364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff949f428ff400) 00010000:00010000:1.0:1789136192.162446:0:23364:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19c00/0xedd53ca6b6e478be lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136192.162455:0:23364:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19c00/0xedd53ca6b6e478be lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136192.162461:0:23364:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789136192.162520:0:23364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a043c6f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d8be90b6-0a63-4a05-9b5e-0fab1488262f+36:2398:x1876044567189504:12345-192.168.206.56@tcp:103:ldlm_bl.0 Request processed in 188us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136192.162528:0:23364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 17 00000100:00100000:1.0:1789136192.162571:0:23364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 18 00000100:00100000:1.0:1789136192.162578:0:23364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f440a12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d8be90b6-0a63-4a05-9b5e-0fab1488262f+35:2398:x1876044567189632:12345-192.168.206.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789136192.162585:0:23364:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789136192.162590:0:23364:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18600/0xedd53ca6b6e477ad lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a0a expref: 35 pid: 26186 timeout: 830 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136192.162599:0:23364:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18600/0xedd53ca6b6e477ad lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a0a expref: 35 pid: 26186 timeout: 830 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136192.162611:0:23364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18600/0xedd53ca6b6e477ad lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a0a expref: 35 pid: 26186 timeout: 830 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136192.162668:0:23364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff949f428ff400) 00010000:00010000:1.0:1789136192.162672:0:23364:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19c00/0xedd53ca6b6e478be lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136192.162679:0:23364:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19c00/0xedd53ca6b6e478be lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136192.162687:0:23364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19c00/0xedd53ca6b6e478be lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136192.162712:0:23364:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789136192.162732:0:23364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f440a12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d8be90b6-0a63-4a05-9b5e-0fab1488262f+34:2398:x1876044567189632:12345-192.168.206.56@tcp:103:ldlm_bl.0 Request processed in 154us (811us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136192.162739:0:23364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 18 00010000:00010000:3.0:1789136192.162912:0:26186:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19c00/0xedd53ca6b6e478be lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136192.162919:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19c00/0xedd53ca6b6e478be lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789136192.162937:0:26186:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00010000:00010000:3.0:1789136192.163250:0:26186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18800/0xedd53ca6b6e478b7 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a50 expref: 35 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136192.163264:0:26186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19c00/0xedd53ca6b6e478be lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a50 expref: 34 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136192.163272:0:26186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff949f428ff400) 00010000:00010000:3.0:1789136192.163274:0:26186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789136192.163277:0:26186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff949f43a19c00, rc 0) 00000100:00100000:3.0:1789136192.163304:0:26186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a04373de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d8be90b6-0a63-4a05-9b5e-0fab1488262f+34:19083:x1876044567189376:12345-192.168.206.56@tcp:101:bash.0 Request processed in 8609us (8899us total) trans 12884901912 rc 0/0 00000100:00100000:3.0:1789136192.163312:0:26186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 50 00000100:00100000:0.0:1789136192.167819:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:3.0:1789136192.167951:0:24752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567189888 00000100:00100000:3.0:1789136192.167960:0:24752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567189888 00000100:00100000:3.0:1789136192.168035:0:24752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 51 00000100:00100000:3.0:1789136192.168045:0:24752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0556fa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8be90b6-0a63-4a05-9b5e-0fab1488262f+34:19083:x1876044567189888:12345-192.168.206.56@tcp:36:bash.0 00010000:00010000:3.0:1789136192.168302:0:24752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32dc00/0xedd53ca6b6e478cc lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136192.168319:0:24752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32dc00/0xedd53ca6b6e478cc lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136192.168329:0:24752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32dc00/0xedd53ca6b6e478cc lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24752 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789136192.168370:0:24752:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000004:00010000:3.0:1789136192.168391:0:24752:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000069f88fba reply state 000000006bd60591 transno 12884901914 ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32dc00/0xedd53ca6b6e478cc lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136192.168402:0:24752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32dc00/0xedd53ca6b6e478cc lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136192.168408:0:24752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff949f428ff400) 00010000:00010000:3.0:1789136192.168410:0:24752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789136192.168414:0:24752:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789136192.168509:0:24752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0556fa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8be90b6-0a63-4a05-9b5e-0fab1488262f+37:19083:x1876044567189888:12345-192.168.206.56@tcp:36:bash.0 Request processed in 465us (703us total) trans 12884901914 rc 0/0 00000100:00100000:3.0:1789136192.168516:0:24752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 51 00000020:00080000:3.0:1789136192.168521:0:24752:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789136192.171709:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:2.0:1789136192.171798:0:23378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567190016 00000100:00100000:2.0:1789136192.171807:0:23378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567190016 00000100:00100000:2.0:1789136192.171879:0:23378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 52 00000100:00100000:2.0:1789136192.171890:0:23378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a04373d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8be90b6-0a63-4a05-9b5e-0fab1488262f+37:19083:x1876044567190016:12345-192.168.206.56@tcp:101:bash.0 00010000:00010000:2.0:1789136192.171913:0:23378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789136192.171932:0:23378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9400/0xedd53ca6b6e478d3 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19d4d74b7ccf4a57 expref: -99 pid: 23378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136192.172014:0:23378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9400/0xedd53ca6b6e478d3 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a57 expref: 38 pid: 23378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136192.172029:0:23378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9400/0xedd53ca6b6e478d3 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a57 expref: 38 pid: 23378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136192.172047:0:23378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff949f428ff400) 00010000:00010000:2.0:1789136192.172050:0:23378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789136192.172054:0:23378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94a0773e9400, rc 0) 00000100:00100000:2.0:1789136192.172125:0:23378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a04373d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8be90b6-0a63-4a05-9b5e-0fab1488262f+38:19083:x1876044567190016:12345-192.168.206.56@tcp:101:bash.0 Request processed in 222us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136192.172133:0:23378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 52 00000100:00100000:2.0:1789136192.178333:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:3.0:1789136192.178412:0:26186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567190144 00000100:00100000:3.0:1789136192.178422:0:26186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567190144 00000100:00100000:3.0:1789136192.178545:0:26186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 53 00000100:00100000:3.0:1789136192.178556:0:26186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f440a3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d8be90b6-0a63-4a05-9b5e-0fab1488262f+38:19083:x1876044567190144:12345-192.168.206.56@tcp:101:bash.0 00010000:00010000:3.0:1789136192.178591:0:26186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789136192.178611:0:26186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32c200/0xedd53ca6b6e478da lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19d4d74b7ccf4a5e expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136192.178738:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32d600/0xedd53ca6b6e478e1 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136192.178753:0:26186:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19c00/0xedd53ca6b6e478be lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a50 expref: 39 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136192.178761:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32d600/0xedd53ca6b6e478e1 lrc: 4/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136192.178794:0:26186:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19c00/0xedd53ca6b6e478be lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a50 expref: 39 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136192.178808:0:26186:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19c00/0xedd53ca6b6e478be lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a50 expref: 39 pid: 26186 timeout: 830 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136192.178821:0:26186:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a04373e1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:26186:1876044587232256:192.168.206.56@tcp:104: 00000100:00100000:3.0:1789136192.178891:0:26186:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a045446000 going to sleep for 11 seconds 00000100:00100000:0.0:1789136192.181347:0:26186:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a04373e1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:26186:1876044587232256:192.168.206.56@tcp:104: 00010000:00010000:0.0:1789136192.181386:0:26186:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32d600/0xedd53ca6b6e478e1 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136192.183067:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:0.0:1789136192.183463:0:23363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567190272 00000100:00100000:0.0:1789136192.183472:0:23363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567190272 00010000:00010000:0.0:1789136192.183512:0:23363:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19c00/0xedd53ca6b6e478be lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a50 expref: 40 pid: 26186 timeout: 830 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136192.183555:0:23363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 19 00000100:00100000:0.0:1789136192.183564:0:23363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f440a21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d8be90b6-0a63-4a05-9b5e-0fab1488262f+40:2398:x1876044567190272:12345-192.168.206.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789136192.183578:0:23363:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789136192.183585:0:23363:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19c00/0xedd53ca6b6e478be lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a50 expref: 40 pid: 26186 timeout: 830 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136192.183599:0:23363:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19c00/0xedd53ca6b6e478be lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a50 expref: 40 pid: 26186 timeout: 830 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136192.183624:0:23363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19c00/0xedd53ca6b6e478be lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a50 expref: 40 pid: 26186 timeout: 830 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136192.183690:0:23363:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff949f428ff400) 00010000:00010000:0.0:1789136192.183695:0:23363:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32d600/0xedd53ca6b6e478e1 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136192.183705:0:23363:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32d600/0xedd53ca6b6e478e1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136192.183713:0:23363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32d600/0xedd53ca6b6e478e1 lrc: 4/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136192.183753:0:23363:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789136192.183804:0:23363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f440a21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d8be90b6-0a63-4a05-9b5e-0fab1488262f+39:2398:x1876044567190272:12345-192.168.206.56@tcp:103:ldlm_bl.0 Request processed in 241us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136192.183813:0:23363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 19 00010000:00010000:3.0:1789136192.184083:0:26186:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32d600/0xedd53ca6b6e478e1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136192.184092:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32d600/0xedd53ca6b6e478e1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789136192.184267:0:26186:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1789136192.184273:0:26186:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789136192.184317:0:26186:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32d600/0xedd53ca6b6e478e1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136192.184349:0:26186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32c200/0xedd53ca6b6e478da lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a5e expref: 39 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136192.184364:0:26186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32d600/0xedd53ca6b6e478e1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a5e expref: 38 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136192.184372:0:26186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff949f428ff400) 00010000:00010000:3.0:1789136192.184374:0:26186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789136192.184377:0:26186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94a07a32d600, rc 0) 00000100:00100000:3.0:1789136192.184999:0:26186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f440a3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d8be90b6-0a63-4a05-9b5e-0fab1488262f+38:19083:x1876044567190144:12345-192.168.206.56@tcp:101:bash.0 Request processed in 6442us (6671us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136192.185009:0:26186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 53 00000100:00100000:3.0:1789136192.191177:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:1.0:1789136192.191277:0:23365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567190528 00000100:00100000:1.0:1789136192.191287:0:23365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567190528 00000100:00100000:1.0:1789136192.191386:0:23365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 3 00000100:00100000:1.0:1789136192.191396:0:23365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a04373e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d8be90b6-0a63-4a05-9b5e-0fab1488262f+38:19083:x1876044567190528:12345-192.168.206.56@tcp:103:bash.0 00010000:00010000:1.0:1789136192.191411:0:23365:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789136192.191434:0:23365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9400/0xedd53ca6b6e478d3 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a57 expref: 38 pid: 23378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136192.191456:0:23365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32d600/0xedd53ca6b6e478e1 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a5e expref: 37 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136192.191466:0:23365:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff949f428ff400) 00010000:00010000:1.0:1789136192.191471:0:23365:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789136192.191551:0:23365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a04373e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d8be90b6-0a63-4a05-9b5e-0fab1488262f+36:19083:x1876044567190528:12345-192.168.206.56@tcp:103:bash.0 Request processed in 155us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136192.191560:0:23365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 3 00000100:00100000:0.0:1789136192.193797:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:2.0:1789136192.194185:0:23380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567190656 00000100:00100000:2.0:1789136192.194194:0:23380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567190656 00000100:00100000:2.0:1789136192.194278:0:23380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 54 00000100:00100000:2.0:1789136192.194288:0:23380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0556f8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8be90b6-0a63-4a05-9b5e-0fab1488262f+36:19083:x1876044567190656:12345-192.168.206.56@tcp:58:bash.0 00010000:00010000:2.0:1789136192.194385:0:23380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8600/0xedd53ca6b6e478e8 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136192.194402:0:23380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8600/0xedd53ca6b6e478e8 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136192.194413:0:23380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8600/0xedd53ca6b6e478e8 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23380 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789136192.195815:0:23380:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789136192.195848:0:23380:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:2.0:1789136192.195987:0:23380:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:2.0:1789136192.196698:0:23380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0556f8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8be90b6-0a63-4a05-9b5e-0fab1488262f+36:19083:x1876044567190656:12345-192.168.206.56@tcp:58:bash.0 Request processed in 2406us (2903us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136192.196708:0:23380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 54 00000100:00100000:2.0:1789136192.200521:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:0.0:1789136192.200748:0:23379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567190784 00000100:00100000:0.0:1789136192.200757:0:23379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567190784 00000100:00100000:0.0:1789136192.200845:0:23379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 55 00000100:00100000:0.0:1789136192.200855:0:23379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f440a2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8be90b6-0a63-4a05-9b5e-0fab1488262f+36:19083:x1876044567190784:12345-192.168.206.56@tcp:101:bash.0 00010000:00010000:0.0:1789136192.200873:0:23379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136192.200892:0:23379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19c00/0xedd53ca6b6e478ef lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19d4d74b7ccf4a65 expref: -99 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136192.200946:0:23379:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8600/0xedd53ca6b6e478e8 lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 23380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136192.200957:0:23379:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19c00/0xedd53ca6b6e478ef lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a65 expref: 37 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136192.201186:0:23379:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8600/0xedd53ca6b6e478e8 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 23380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136192.201203:0:23379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19c00/0xedd53ca6b6e478ef lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a65 expref: 37 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136192.201216:0:23379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff949f428ff400) 00010000:00010000:0.0:1789136192.201219:0:23379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789136192.201236:0:23379:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19c00/0xedd53ca6b6e478ef lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a65 expref: 37 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136192.201245:0:23379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff949f43a19c00, rc 0) 00000100:00100000:0.0:1789136192.201346:0:23379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f440a2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8be90b6-0a63-4a05-9b5e-0fab1488262f+37:19083:x1876044567190784:12345-192.168.206.56@tcp:101:bash.0 Request processed in 492us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136192.201354:0:23379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 55 00000100:00100000:0.0:1789136192.235398:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:3.0:1789136192.236093:0:23373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567190912 00000100:00100000:3.0:1789136192.236101:0:23373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567190912 00000100:00100000:3.0:1789136192.236169:0:23373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 166 00000100:00100000:3.0:1789136192.236178:0:23373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0769c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbab00a5-62cb-4304-af69-c2de8be80f81+13:2397:x1876044567190912:12345-192.168.206.56@tcp:400:kworker.0 00000100:00100000:3.0:1789136192.236246:0:23373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0769c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbab00a5-62cb-4304-af69-c2de8be80f81+13:2397:x1876044567190912:12345-192.168.206.56@tcp:400:kworker.0 Request processed in 69us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136192.236253:0:23373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 166 00000100:00100000:2.0:1789136192.239310:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:3.0:1789136192.239499:0:26186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567191040 00000100:00100000:3.0:1789136192.239510:0:26186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567191040 00000100:00100000:3.0:1789136192.239677:0:26186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 62 00000100:00100000:3.0:1789136192.239688:0:26186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f440a0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d8be90b6-0a63-4a05-9b5e-0fab1488262f+5:2397:x1876044567191040:12345-192.168.206.56@tcp:400:kworker.0 00000100:00100000:3.0:1789136192.239774:0:26186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f440a0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d8be90b6-0a63-4a05-9b5e-0fab1488262f+5:2397:x1876044567191040:12345-192.168.206.56@tcp:400:kworker.0 Request processed in 89us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136192.239782:0:26186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 62 00000100:00080000:1.0:1789136192.241410:0:23374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789136192.242447:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:2.0:1789136192.242486:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:2.0:1789136192.242517:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:2.0:1789136192.242542:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:2.0:1789136192.242560:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:2.0:1789136192.242581:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:0.0:1789136192.242651:0:24895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567191296 00000100:00100000:0.0:1789136192.242660:0:24895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567191296 00000100:00100000:0.0:1789136192.242715:0:24895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567191808 00000100:00100000:0.0:1789136192.242717:0:24895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567191808 00000100:00100000:0.0:1789136192.242732:0:24895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567191168 00000100:00100000:0.0:1789136192.242734:0:24895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567191168 00000100:00100000:0.0:1789136192.242743:0:24895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567191680 00000100:00100000:0.0:1789136192.242745:0:24895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567191680 00000100:00100000:0.0:1789136192.242757:0:24895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 17 00000100:00100000:0.0:1789136192.242765:0:24895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f440a0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d8be90b6-0a63-4a05-9b5e-0fab1488262f+5:2398:x1876044567191296:12345-192.168.206.56@tcp:400:kworker.0 00000100:00100000:0.0:1789136192.242827:0:24895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f440a0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d8be90b6-0a63-4a05-9b5e-0fab1488262f+5:2398:x1876044567191296:12345-192.168.206.56@tcp:400:kworker.0 Request processed in 63us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136192.242834:0:24895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 17 00000100:00100000:0.0:1789136192.242849:0:24895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 18 00000100:00100000:0.0:1789136192.242855:0:24895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f440a2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1bed3215-c3a6-4f6f-b765-010543ef4acb+5:2398:x1876044567191808:12345-192.168.206.56@tcp:400:kworker.0 00000100:00100000:0.0:1789136192.242876:0:24895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f440a2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1bed3215-c3a6-4f6f-b765-010543ef4acb+5:2398:x1876044567191808:12345-192.168.206.56@tcp:400:kworker.0 Request processed in 22us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136192.242881:0:24895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 18 00000100:00100000:0.0:1789136192.242891:0:24895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 19 00000100:00100000:0.0:1789136192.242908:0:24895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f440a1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d8be90b6-0a63-4a05-9b5e-0fab1488262f+5:2398:x1876044567191168:12345-192.168.206.56@tcp:400:kworker.0 00000100:00100000:0.0:1789136192.242932:0:24895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f440a1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d8be90b6-0a63-4a05-9b5e-0fab1488262f+5:2398:x1876044567191168:12345-192.168.206.56@tcp:400:kworker.0 Request processed in 25us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136192.242938:0:24895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 19 00000100:00100000:0.0:1789136192.242949:0:24895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 20 00000100:00100000:0.0:1789136192.242955:0:24895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f440a1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1bed3215-c3a6-4f6f-b765-010543ef4acb+5:2398:x1876044567191680:12345-192.168.206.56@tcp:400:kworker.0 00000100:00100000:0.0:1789136192.242990:0:24895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f440a1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1bed3215-c3a6-4f6f-b765-010543ef4acb+5:2398:x1876044567191680:12345-192.168.206.56@tcp:400:kworker.0 Request processed in 35us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136192.243006:0:24895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 20 00000100:00100000:3.0:1789136192.243491:0:23380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567191552 00000100:00100000:3.0:1789136192.243499:0:23380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567191552 00000100:00100000:3.0:1789136192.243543:0:23380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567191424 00000100:00100000:3.0:1789136192.243546:0:23380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567191424 00000100:00100000:3.0:1789136192.243572:0:23380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 63 00000100:00100000:3.0:1789136192.243580:0:23380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f440a3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1bed3215-c3a6-4f6f-b765-010543ef4acb+5:2398:x1876044567191552:12345-192.168.206.56@tcp:400:kworker.0 00000100:00100000:3.0:1789136192.243623:0:23380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f440a3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1bed3215-c3a6-4f6f-b765-010543ef4acb+5:2398:x1876044567191552:12345-192.168.206.56@tcp:400:kworker.0 Request processed in 43us (1136us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136192.243657:0:23380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 63 00000100:00100000:3.0:1789136192.243672:0:23380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 64 00000100:00100000:3.0:1789136192.243679:0:23380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f440a1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1bed3215-c3a6-4f6f-b765-010543ef4acb+12:2398:x1876044567191424:12345-192.168.206.56@tcp:400:kworker.0 00000100:00100000:3.0:1789136192.243710:0:23380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f440a1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1bed3215-c3a6-4f6f-b765-010543ef4acb+12:2398:x1876044567191424:12345-192.168.206.56@tcp:400:kworker.0 Request processed in 31us (1148us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136192.243716:0:23380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 64 00000100:00080000:2.0:1789136192.244307:0:23374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789136192.244312:0:23374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789136192.244314:0:23374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789136192.244316:0:23374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:1.0:1789136192.370302:0:24136:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789136192.818653:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789136193.200826:0:23417:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1789136193.200836:0:23417:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789136193.200861:0:23417:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:1.0:1789136193.200869:0:23417:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1789136193.201010:0:23417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f429f92c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:23417:1876044587232384:192.168.206.56@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789136193.201099:0:23417:0:(client.c:2715:ptlrpc_set_wait()) set ffff949f434356c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789136193.210327:0:23417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f429f92c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:23417:1876044587232384:192.168.206.56@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789136193.218838:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:0.0:1789136193.221125:0:23378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567191936 00000100:00100000:0.0:1789136193.221142:0:23378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567191936 00000100:00100000:0.0:1789136193.221217:0:23378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 56 00000100:00100000:0.0:1789136193.221227:0:23378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a04373cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8be90b6-0a63-4a05-9b5e-0fab1488262f+37:19084:x1876044567191936:12345-192.168.206.56@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789136193.221261:0:23378:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789136193.221481:0:23378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a04373cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8be90b6-0a63-4a05-9b5e-0fab1488262f+37:19084:x1876044567191936:12345-192.168.206.56@tcp:53:lhsmtool_posix.0 Request processed in 254us (2652us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136193.221490:0:23378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 56 00000100:00100000:0.0:1789136193.240557:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:3.0:1789136193.240686:0:26186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567192064 00000100:00100000:3.0:1789136193.240695:0:26186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567192064 00000100:00100000:3.0:1789136193.240754:0:26186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 57 00000100:00100000:3.0:1789136193.240765:0:26186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0556fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d8be90b6-0a63-4a05-9b5e-0fab1488262f+37:19084:x1876044567192064:12345-192.168.206.56@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789136193.240837:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32c200/0xedd53ca6b6e478f6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136193.240873:0:26186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32c200/0xedd53ca6b6e478f6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136193.240887:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32c200/0xedd53ca6b6e478f6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136193.240936:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32d200/0xedd53ca6b6e478fd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136193.240944:0:26186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32d200/0xedd53ca6b6e478fd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136193.240950:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32d200/0xedd53ca6b6e478fd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136193.240973:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32c600/0xedd53ca6b6e47904 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136193.240981:0:26186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32c600/0xedd53ca6b6e47904 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136193.240987:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32c600/0xedd53ca6b6e47904 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789136193.241031:0:26186:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1789136193.241035:0:26186:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789136193.241047:0:26186:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32c600/0xedd53ca6b6e47904 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136193.241058:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32c200/0xedd53ca6b6e478f6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136193.241076:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32c200/0xedd53ca6b6e478f6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136193.241082:0:26186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32c200/0xedd53ca6b6e478f6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136193.241088:0:26186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a07a32c200 already unused, calling callback (ffffffffc19d34f0) 00010000:00010000:3.0:1789136193.241092:0:26186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32c200/0xedd53ca6b6e478f6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136193.241099:0:26186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32c200/0xedd53ca6b6e478f6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136193.241133:0:26186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff949f428fff00) 00010000:00010000:3.0:1789136193.241135:0:26186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789136193.241140:0:26186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32c200/0xedd53ca6b6e478f6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136193.241146:0:26186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32c200/0xedd53ca6b6e478f6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136193.241158:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32d200/0xedd53ca6b6e478fd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136193.241163:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32d200/0xedd53ca6b6e478fd lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136193.241169:0:26186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32d200/0xedd53ca6b6e478fd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136193.241173:0:26186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a07a32d200 already unused, calling callback (ffffffffc19d34f0) 00010000:00010000:3.0:1789136193.241182:0:26186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32d200/0xedd53ca6b6e478fd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136193.241188:0:26186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32d200/0xedd53ca6b6e478fd lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136193.241196:0:26186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff94a055e92300) 00010000:00010000:3.0:1789136193.241199:0:26186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789136193.241201:0:26186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32d200/0xedd53ca6b6e478fd lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136193.241207:0:26186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32d200/0xedd53ca6b6e478fd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136193.241220:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32c600/0xedd53ca6b6e47904 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136193.241224:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32c600/0xedd53ca6b6e47904 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136193.241229:0:26186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32c600/0xedd53ca6b6e47904 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136193.241232:0:26186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a07a32c600 already unused, calling callback (ffffffffc19d34f0) 00010000:00010000:3.0:1789136193.241235:0:26186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32c600/0xedd53ca6b6e47904 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136193.241240:0:26186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32c600/0xedd53ca6b6e47904 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136193.241245:0:26186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff949f428ff400) 00010000:00010000:3.0:1789136193.241247:0:26186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789136193.241255:0:26186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32c600/0xedd53ca6b6e47904 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136193.241261:0:26186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32c600/0xedd53ca6b6e47904 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136193.242345:0:26186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0556fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d8be90b6-0a63-4a05-9b5e-0fab1488262f+37:19084:x1876044567192064:12345-192.168.206.56@tcp:34:lhsmtool_posix.0 Request processed in 1576us (1790us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136193.242356:0:26186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 57 00000100:00100000:2.0:1789136193.259655:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:1.0:1789136193.259757:0:24752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567192320 00000100:00100000:1.0:1789136193.259766:0:24752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567192320 00000100:00100000:1.0:1789136193.259813:0:24752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 58 00000100:00100000:1.0:1789136193.259823:0:24752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f440a03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8be90b6-0a63-4a05-9b5e-0fab1488262f+37:19084:x1876044567192320:12345-192.168.206.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789136193.259843:0:24752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789136193.259861:0:24752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94a060036200/0xedd53ca6b6e4790b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19d4d74b7ccf4a6c expref: -99 pid: 24752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136193.259976:0:24752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94a060037c00/0xedd53ca6b6e47912 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 24752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136193.259993:0:24752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94a060037c00/0xedd53ca6b6e47912 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 24752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136193.260005:0:24752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94a060037c00/0xedd53ca6b6e47912 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24752 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789136193.260035:0:24752:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789136193.260131:0:24752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94a060037c00/0xedd53ca6b6e47912 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 24752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136193.260139:0:24752:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94a060037c00/0xedd53ca6b6e47912 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 24752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136193.260146:0:24752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94a060037c00/0xedd53ca6b6e47912 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 24752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136193.260152:0:24752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a060037c00 already unused, calling callback (ffffffffc19d34f0) 00010000:00010000:1.0:1789136193.260157:0:24752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94a060037c00/0xedd53ca6b6e47912 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 24752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136193.260164:0:24752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94a060037c00/0xedd53ca6b6e47912 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 24752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136193.260175:0:24752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff949f428ff400) 00010000:00010000:1.0:1789136193.260179:0:24752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789136193.260183:0:24752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94a060037c00/0xedd53ca6b6e47912 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 24752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136193.260189:0:24752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94a060037c00/0xedd53ca6b6e47912 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 24752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136193.260244:0:24752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94a060036200/0xedd53ca6b6e4790b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a6c expref: 39 pid: 24752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136193.260254:0:24752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff949f428fff00) 00010000:00010000:1.0:1789136193.260256:0:24752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789136193.260535:0:24752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94a060036200/0xedd53ca6b6e4790b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a6c expref: 39 pid: 24752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136193.260549:0:24752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94a060036200, rc 0) 00000100:00100000:1.0:1789136193.260619:0:24752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f440a03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8be90b6-0a63-4a05-9b5e-0fab1488262f+38:19084:x1876044567192320:12345-192.168.206.56@tcp:101:lhsmtool_posix.0 Request processed in 797us (971us total) trans 12884901915 rc 301/301 00000100:00100000:1.0:1789136193.260670:0:24752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 58 00000100:00100000:2.0:1789136193.264387:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:3.0:1789136193.264546:0:23380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567192448 00000100:00100000:3.0:1789136193.264556:0:23380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567192448 00000100:00100000:3.0:1789136193.264609:0:23380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 59 00000100:00100000:3.0:1789136193.264620:0:23380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f440a2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8be90b6-0a63-4a05-9b5e-0fab1488262f+38:19084:x1876044567192448:12345-192.168.206.56@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789136193.264690:0:23380:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789136193.264791:0:23380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f440a2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8be90b6-0a63-4a05-9b5e-0fab1488262f+38:19084:x1876044567192448:12345-192.168.206.56@tcp:53:lhsmtool_posix.0 Request processed in 173us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136193.264799:0:23380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 59 00000100:00100000:2.0:1789136193.268110:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:3.0:1789136193.269300:0:26186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567192704 00000100:00100000:3.0:1789136193.269390:0:26186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567192704 00000100:00100000:3.0:1789136193.269501:0:26186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 60 00000100:00100000:3.0:1789136193.269512:0:26186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f440a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d8be90b6-0a63-4a05-9b5e-0fab1488262f+38:19084:x1876044567192704:12345-192.168.206.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789136193.269534:0:26186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789136193.269554:0:26186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32c600/0xedd53ca6b6e47920 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19d4d74b7ccf4a73 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789136193.269951:0:26186:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x6:0x0], count =60 00000004:00080000:3.0:1789136193.269980:0:26186:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x6:0x0]+60 in llog 00000004:00080000:3.0:1789136193.270001:0:26186:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x42:0x0], index 1: 0 00010000:00010000:3.0:1789136193.270173:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32d200/0xedd53ca6b6e47927 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136193.270187:0:26186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32d200/0xedd53ca6b6e47927 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136193.270199:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32d200/0xedd53ca6b6e47927 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136193.270787:0:26186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32c600/0xedd53ca6b6e47920 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a73 expref: 41 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136193.270807:0:26186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32d200/0xedd53ca6b6e47927 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a73 expref: 40 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136193.270817:0:26186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff94a055e92300) 00010000:00010000:3.0:1789136193.270820:0:26186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789136193.270824:0:26186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94a07a32d200, rc 0) 00000100:00100000:3.0:1789136193.270892:0:26186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f440a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d8be90b6-0a63-4a05-9b5e-0fab1488262f+40:19084:x1876044567192704:12345-192.168.206.56@tcp:101:lhsmtool_posix.0 Request processed in 1382us (2796us total) trans 12884901916 rc 0/0 00000100:00100000:3.0:1789136193.270899:0:26186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 60 00000100:00100000:2.0:1789136193.275924:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:0.0:1789136193.276083:0:23378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567192960 00000100:00100000:0.0:1789136193.276092:0:23378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567192960 00000100:00100000:0.0:1789136193.276195:0:23378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 61 00000100:00100000:0.0:1789136193.276206:0:23378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f440a30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8be90b6-0a63-4a05-9b5e-0fab1488262f+40:19084:x1876044567192960:12345-192.168.206.56@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789136193.276272:0:23378:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789136193.276299:0:23378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32d200/0xedd53ca6b6e47927 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a73 expref: 40 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.276407:0:23378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff94a055e92300) 00010000:00010000:0.0:1789136193.276418:0:23378:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789136193.276449:0:23378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19a00/0xedd53ca6b6e47935 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.276462:0:23378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19a00/0xedd53ca6b6e47935 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.276473:0:23378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19a00/0xedd53ca6b6e47935 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.276487:0:23378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19000/0xedd53ca6b6e4793c lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x6342bc8e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.276495:0:23378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19000/0xedd53ca6b6e4793c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x6342bc8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.276501:0:23378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19000/0xedd53ca6b6e4793c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x6342bc8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.276542:0:23378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19a00/0xedd53ca6b6e47935 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.276550:0:23378:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19a00/0xedd53ca6b6e47935 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.276557:0:23378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19a00/0xedd53ca6b6e47935 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.276563:0:23378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff949f43a19a00 already unused, calling callback (ffffffffc19d34f0) 00010000:00010000:0.0:1789136193.276567:0:23378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19a00/0xedd53ca6b6e47935 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.276582:0:23378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19a00/0xedd53ca6b6e47935 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.276592:0:23378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff94a0490dfd00) 00010000:00010000:0.0:1789136193.276594:0:23378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789136193.276598:0:23378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19a00/0xedd53ca6b6e47935 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.276604:0:23378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19a00/0xedd53ca6b6e47935 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.276613:0:23378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19000/0xedd53ca6b6e4793c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x6342bc8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.276619:0:23378:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19000/0xedd53ca6b6e4793c lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x6342bc8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.276625:0:23378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19000/0xedd53ca6b6e4793c lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x6342bc8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.276668:0:23378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff949f43a19000 already unused, calling callback (ffffffffc19d34f0) 00010000:00010000:0.0:1789136193.276671:0:23378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19000/0xedd53ca6b6e4793c lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x6342bc8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.276678:0:23378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19000/0xedd53ca6b6e4793c lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x6342bc8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.276685:0:23378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x6342bc8e (ffff949f428ffe00) 00010000:00010000:0.0:1789136193.276688:0:23378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789136193.276691:0:23378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19000/0xedd53ca6b6e4793c lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x6342bc8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.276707:0:23378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19000/0xedd53ca6b6e4793c lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x6342bc8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136193.276855:0:23378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f440a30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8be90b6-0a63-4a05-9b5e-0fab1488262f+39:19084:x1876044567192960:12345-192.168.206.56@tcp:36:lhsmtool_posix.0 Request processed in 650us (938us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789136193.276863:0:23378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 61 00000100:00100000:2.0:1789136193.279720:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:1.0:1789136193.279854:0:23379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567193088 00000100:00100000:1.0:1789136193.279863:0:23379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567193088 00000100:00100000:1.0:1789136193.279929:0:23379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 62 00000100:00100000:1.0:1789136193.279940:0:23379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f440a0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8be90b6-0a63-4a05-9b5e-0fab1488262f+39:19084:x1876044567193088:12345-192.168.206.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789136193.280075:0:23379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789136193.280165:0:23379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94a060036200/0xedd53ca6b6e47943 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19d4d74b7ccf4a7a expref: -99 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136193.280266:0:23379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94a060037c00/0xedd53ca6b6e4794a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136193.280281:0:23379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94a060037c00/0xedd53ca6b6e4794a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136193.280293:0:23379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94a060037c00/0xedd53ca6b6e4794a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136193.280480:0:23379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94a060036200/0xedd53ca6b6e47943 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a7a expref: 41 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136193.280501:0:23379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94a060037c00/0xedd53ca6b6e4794a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a7a expref: 40 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136193.280523:0:23379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff949f42820200) 00010000:00010000:1.0:1789136193.280526:0:23379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789136193.280530:0:23379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94a060037c00, rc 0) 00000100:00100000:1.0:1789136193.280755:0:23379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f440a0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8be90b6-0a63-4a05-9b5e-0fab1488262f+40:19084:x1876044567193088:12345-192.168.206.56@tcp:101:lhsmtool_posix.0 Request processed in 815us (1047us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136193.280763:0:23379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 62 00000100:00100000:2.0:1789136193.285014:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:0.0:1789136193.285091:0:26186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567193344 00000100:00100000:0.0:1789136193.285119:0:26186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567193344 00000100:00100000:0.0:1789136193.285182:0:26186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 63 00000100:00100000:0.0:1789136193.285198:0:26186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a07f9dc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d8be90b6-0a63-4a05-9b5e-0fab1488262f+40:19084:x1876044567193344:12345-192.168.206.56@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789136193.285282:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18600/0xedd53ca6b6e47951 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.285299:0:26186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18600/0xedd53ca6b6e47951 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.285310:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18600/0xedd53ca6b6e47951 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789136193.285482:0:26186:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].2, 88 off8344 00000004:00080000:0.0:1789136193.285492:0:26186:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 731379863878ns, next at 732379860638ns, rc = 0 00000004:00010000:0.0:1789136193.285546:0:26186:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000cad659de reply state 000000004dca6f13 transno 12884901917 ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18600/0xedd53ca6b6e47951 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.285559:0:26186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18600/0xedd53ca6b6e47951 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.285567:0:26186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff949f42820200) 00010000:00010000:0.0:1789136193.285578:0:26186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1789136193.285582:0:26186:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789136193.285949:0:26186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a07f9dc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d8be90b6-0a63-4a05-9b5e-0fab1488262f+42:19084:x1876044567193344:12345-192.168.206.56@tcp:36:lhsmtool_posix.0 Request processed in 756us (943us total) trans 12884901917 rc 0/0 00000100:00100000:0.0:1789136193.285957:0:26186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 63 00000100:00100000:2.0:1789136193.288059:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:0.0:1789136193.291290:0:23378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567193472 00000100:00100000:0.0:1789136193.291306:0:23378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567193472 00000100:00100000:0.0:1789136193.291379:0:23378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 64 00000100:00100000:0.0:1789136193.291389:0:23378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a07f9de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8be90b6-0a63-4a05-9b5e-0fab1488262f+42:19084:x1876044567193472:12345-192.168.206.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789136193.291415:0:23378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136193.291436:0:23378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19000/0xedd53ca6b6e47958 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19d4d74b7ccf4a81 expref: -99 pid: 23378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.291494:0:23378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19000/0xedd53ca6b6e47958 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a81 expref: 43 pid: 23378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.291509:0:23378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19000/0xedd53ca6b6e47958 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a81 expref: 43 pid: 23378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.291526:0:23378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff949f42820200) 00010000:00010000:0.0:1789136193.291529:0:23378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789136193.291533:0:23378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff949f43a19000, rc 0) 00000100:00100000:0.0:1789136193.291873:0:23378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a07f9de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8be90b6-0a63-4a05-9b5e-0fab1488262f+43:19084:x1876044567193472:12345-192.168.206.56@tcp:101:lhsmtool_posix.0 Request processed in 483us (3820us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136193.291881:0:23378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 64 00000100:00100000:2.0:1789136193.295077:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:0.0:1789136193.295239:0:24895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567193600 00000100:00100000:0.0:1789136193.295248:0:24895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567193600 00000100:00100000:0.0:1789136193.295308:0:24895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 20 00000100:00100000:0.0:1789136193.295344:0:24895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a07f9dd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d8be90b6-0a63-4a05-9b5e-0fab1488262f+5:2396:x1876044567193600:12345-192.168.206.56@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1789136193.295606:0:24895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a07f9dd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d8be90b6-0a63-4a05-9b5e-0fab1488262f+6:2396:x1876044567193600:12345-192.168.206.56@tcp:2:lhsmtool_posix.0 Request processed in 265us (539us total) trans 12884901891 rc 0/0 00000100:00100000:0.0:1789136193.295614:0:24895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 20 00000100:00100000:1.0:1789136193.298530:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:3.0:1789136193.298623:0:23381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567193856 00000100:00100000:3.0:1789136193.298672:0:23381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567193856 00000100:00100000:3.0:1789136193.298732:0:23381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 11 00000100:00100000:3.0:1789136193.298742:0:23381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f429f92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d8be90b6-0a63-4a05-9b5e-0fab1488262f+43:19084:x1876044567193856:12345-192.168.206.56@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789136193.298967:0:23381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f429f92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d8be90b6-0a63-4a05-9b5e-0fab1488262f+44:19084:x1876044567193856:12345-192.168.206.56@tcp:35:lhsmtool_posix.0 Request processed in 226us (445us total) trans 12884901918 rc 0/0 00000100:00100000:3.0:1789136193.298975:0:23381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 11 00000100:00100000:3.0:1789136193.302129:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:1.0:1789136193.302265:0:23379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567194112 00000100:00100000:1.0:1789136193.302274:0:23379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567194112 00000100:00100000:1.0:1789136193.302346:0:23379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 65 00000100:00100000:1.0:1789136193.302358:0:23379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a055722940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8be90b6-0a63-4a05-9b5e-0fab1488262f+44:19084:x1876044567194112:12345-192.168.206.56@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789136193.302490:0:23379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a055722940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8be90b6-0a63-4a05-9b5e-0fab1488262f+44:19084:x1876044567194112:12345-192.168.206.56@tcp:57:lhsmtool_posix.0 Request processed in 134us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136193.302498:0:23379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 65 00000100:00100000:0.0:1789136193.305384:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:3.0:1789136193.305712:0:26186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567194240 00000100:00100000:3.0:1789136193.305720:0:26186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567194240 00000100:00100000:3.0:1789136193.305787:0:26186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 66 00000100:00100000:3.0:1789136193.305799:0:26186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0556fad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d8be90b6-0a63-4a05-9b5e-0fab1488262f+44:19084:x1876044567194240:12345-192.168.206.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789136193.305819:0:26186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789136193.305840:0:26186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32c600/0xedd53ca6b6e4795f lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19d4d74b7ccf4a88 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136193.305934:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32c200/0xedd53ca6b6e47966 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136193.305949:0:26186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32c200/0xedd53ca6b6e47966 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136193.305959:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32c200/0xedd53ca6b6e47966 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789136193.306001:0:26186:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789136193.306021:0:26186:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32c200/0xedd53ca6b6e47966 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136193.306047:0:26186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32c600/0xedd53ca6b6e4795f lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a88 expref: 46 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136193.306064:0:26186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32c200/0xedd53ca6b6e47966 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a88 expref: 45 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136193.306072:0:26186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff949f42820200) 00010000:00010000:3.0:1789136193.306075:0:26186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789136193.306086:0:26186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94a07a32c200, rc 0) 00000100:00100000:3.0:1789136193.306324:0:26186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0556fad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d8be90b6-0a63-4a05-9b5e-0fab1488262f+45:19084:x1876044567194240:12345-192.168.206.56@tcp:101:lhsmtool_posix.0 Request processed in 518us (938us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136193.306333:0:26186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 66 00000100:00100000:1.0:1789136193.312520:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:2.0:1789136193.312749:0:24892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567194368 00000100:00100000:2.0:1789136193.312774:0:24892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567194368 00000100:00100000:2.0:1789136193.312933:0:24892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 21 00000100:00100000:2.0:1789136193.312944:0:24892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f429fad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d8be90b6-0a63-4a05-9b5e-0fab1488262f+6:2397:x1876044567194368:12345-192.168.206.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789136193.313170:0:24892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789136193.313192:0:24892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ba826a4/0xedd53ca6b6e4796d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x19d4d74b7ccf4a8f expref: -99 pid: 24892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789136193.313220:0:24892:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa40d40, blocks: 0x0 00010000:00010000:2.0:1789136193.313240:0:24892:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=731s v=(0 0) 00010000:00010000:2.0:1789136193.313244:0:24892:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789136193.313255:0:24892:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ba826a4/0xedd53ca6b6e4796d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a8f expref: 7 pid: 24892 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136193.313274:0:24892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004ba826a4/0xedd53ca6b6e4796d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a8f expref: 7 pid: 24892 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136193.313288:0:24892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94a0773e8400, rc 0) 00000100:00100000:2.0:1789136193.313420:0:24892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f429fad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d8be90b6-0a63-4a05-9b5e-0fab1488262f+7:2397:x1876044567194368:12345-192.168.206.56@tcp:101:lhsmtool_posix.0 Request processed in 477us (909us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136193.313428:0:24892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 21 00000100:00100000:3.0:1789136193.316716:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:0.0:1789136193.316813:0:23378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567194624 00000100:00100000:0.0:1789136193.316822:0:23378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567194624 00000100:00100000:0.0:1789136193.316888:0:23378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 67 00000100:00100000:0.0:1789136193.316898:0:23378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0557212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8be90b6-0a63-4a05-9b5e-0fab1488262f+45:19084:x1876044567194624:12345-192.168.206.56@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789136193.317028:0:23378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0557212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8be90b6-0a63-4a05-9b5e-0fab1488262f+45:19084:x1876044567194624:12345-192.168.206.56@tcp:57:lhsmtool_posix.0 Request processed in 131us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136193.317036:0:23378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 67 00000100:00100000:1.0:1789136193.321609:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:3.0:1789136193.322238:0:23380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567194752 00000100:00100000:3.0:1789136193.322248:0:23380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567194752 00000100:00100000:3.0:1789136193.322308:0:23380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 68 00000100:00100000:3.0:1789136193.322491:0:23380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f429fa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8be90b6-0a63-4a05-9b5e-0fab1488262f+45:19084:x1876044567194752:12345-192.168.206.56@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1789136193.324816:0:23358:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901918 is committed 00000004:00080000:1.0:1789136193.324839:0:23358:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:1.0:1789136193.324919:0:23358:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00010000:00010000:2.0:1789136193.325599:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18000/0xedd53ca6b6e4773d lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136193.325617:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18000/0xedd53ca6b6e4773d lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136193.325625:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18000/0xedd53ca6b6e4773d lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23380 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136193.325848:0:23380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f429fa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8be90b6-0a63-4a05-9b5e-0fab1488262f+20:19084:x1876044567194752:12345-192.168.206.56@tcp:44:lhsmtool_posix.0 Request processed in 3525us (4241us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136193.325859:0:23380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 68 00010000:00010000:2.0:1789136193.326136:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff949f43a18000 already unused, calling callback (ffffffffc19d34f0) 00010000:00010000:2.0:1789136193.326141:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18000/0xedd53ca6b6e4773d lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136193.326148:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18000/0xedd53ca6b6e4773d lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136193.326163:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff94a0490dfd00) 00010000:00010000:2.0:1789136193.326166:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1789136193.326171:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18000/0xedd53ca6b6e4773d lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136193.326177:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18000/0xedd53ca6b6e4773d lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23380 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136193.328031:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789136193.328061:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07f6e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876044587232512:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789136193.328150:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136193.328220:0:25792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587232512 00000100:00100000:2.0:1789136193.328227:0:25792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587232512 00000100:00100000:2.0:1789136193.328295:0:25792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789136193.328305:0:25792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a07f9dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3646:x1876044587232512:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1789136193.328453:0:25792:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789136193.328458:0:25792:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1789136193.328460:0:25792:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789136193.328462:0:25792:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1789136192 -> 1789136192 00002000:00010000:2.0:1789136193.328466:0:25792:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00080000:3.0:1789136193.328477:0:23374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789136193.328520:0:25792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a07f9dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3646:x1876044587232512:12345-0@lo:2:osp-syn-1-0.0 Request processed in 216us (369us total) trans 12884901892 rc 0/0 00000100:00100000:2.0:1789136193.328544:0:25792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000004:00080000:3.0:1789136193.328593:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94a07f6e8b40/2, rc 0, transno 12884901892 00000100:00100000:3.0:1789136193.328605:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07f6e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876044587232512:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1789136193.329325:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94a040031e00/0xedd53ca6b6e476e9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.329341:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94a040031e00/0xedd53ca6b6e476e9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.329349:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94a040031e00/0xedd53ca6b6e476e9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.329356:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a040031e00 already unused, calling callback (ffffffffc19d34f0) 00010000:00010000:0.0:1789136193.329362:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94a040031e00/0xedd53ca6b6e476e9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.329370:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94a040031e00/0xedd53ca6b6e476e9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.329411:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff94a0490df000) 00010000:00010000:0.0:1789136193.329415:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789136193.329421:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94a040031e00/0xedd53ca6b6e476e9 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.329427:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94a040031e00/0xedd53ca6b6e476e9 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.329457:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94a040030c00/0xedd53ca6b6e476f0 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.329463:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94a040030c00/0xedd53ca6b6e476f0 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.329469:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94a040030c00/0xedd53ca6b6e476f0 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.329473:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a040030c00 already unused, calling callback (ffffffffc19d34f0) 00010000:00010000:0.0:1789136193.329476:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94a040030c00/0xedd53ca6b6e476f0 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.329481:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94a040030c00/0xedd53ca6b6e476f0 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.329489:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff94a0490dfd00) 00010000:00010000:0.0:1789136193.329491:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789136193.329494:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94a040030c00/0xedd53ca6b6e476f0 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.329499:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94a040030c00/0xedd53ca6b6e476f0 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.329525:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19400/0xedd53ca6b6e477a6 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.329532:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19400/0xedd53ca6b6e477a6 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.329537:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19400/0xedd53ca6b6e477a6 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.329542:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff949f43a19400 already unused, calling callback (ffffffffc19d34f0) 00010000:00010000:0.0:1789136193.329546:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19400/0xedd53ca6b6e477a6 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.329551:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19400/0xedd53ca6b6e477a6 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.330741:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff949f428ffb00) 00010000:00010000:0.0:1789136193.330753:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789136193.330762:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19400/0xedd53ca6b6e477a6 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.331008:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19400/0xedd53ca6b6e477a6 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.331044:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9200/0xedd53ca6b6e47863 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.331051:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9200/0xedd53ca6b6e47863 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.331058:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9200/0xedd53ca6b6e47863 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.331562:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a0773e9200 already unused, calling callback (ffffffffc19d34f0) 00010000:00010000:0.0:1789136193.331568:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9200/0xedd53ca6b6e47863 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.331577:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9200/0xedd53ca6b6e47863 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.331594:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff949f428ff400) 00010000:00010000:0.0:1789136193.331597:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789136193.331601:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9200/0xedd53ca6b6e47863 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.331607:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9200/0xedd53ca6b6e47863 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.331657:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18a00/0xedd53ca6b6e47886 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.331665:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18a00/0xedd53ca6b6e47886 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.331672:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18a00/0xedd53ca6b6e47886 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.331678:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff949f43a18a00 already unused, calling callback (ffffffffc19d34f0) 00010000:00010000:0.0:1789136193.331680:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18a00/0xedd53ca6b6e47886 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.331691:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18a00/0xedd53ca6b6e47886 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.331717:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff949f428ff400) 00010000:00010000:0.0:1789136193.331720:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789136193.331723:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18a00/0xedd53ca6b6e47886 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.331729:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18a00/0xedd53ca6b6e47886 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.331743:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32dc00/0xedd53ca6b6e478cc lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.331749:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32dc00/0xedd53ca6b6e478cc lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.331756:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32dc00/0xedd53ca6b6e478cc lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.331761:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a07a32dc00 already unused, calling callback (ffffffffc19d34f0) 00010000:00010000:0.0:1789136193.331764:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32dc00/0xedd53ca6b6e478cc lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.331900:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32dc00/0xedd53ca6b6e478cc lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.331910:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff949f428ff400) 00010000:00010000:0.0:1789136193.331912:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789136193.331915:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32dc00/0xedd53ca6b6e478cc lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.331921:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32dc00/0xedd53ca6b6e478cc lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.331948:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18600/0xedd53ca6b6e47951 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.331955:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18600/0xedd53ca6b6e47951 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.331961:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18600/0xedd53ca6b6e47951 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.331966:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff949f43a18600 already unused, calling callback (ffffffffc19d34f0) 00010000:00010000:0.0:1789136193.331969:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18600/0xedd53ca6b6e47951 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.331975:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18600/0xedd53ca6b6e47951 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.331983:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff949f42820200) 00010000:00010000:0.0:1789136193.331986:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789136193.331989:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18600/0xedd53ca6b6e47951 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.331995:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18600/0xedd53ca6b6e47951 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136193.334895:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:2.0:1789136193.335137:0:25476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567194880 00000100:00100000:2.0:1789136193.335153:0:25476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567194880 00000100:00100000:2.0:1789136193.335214:0:25476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 23 00000100:00100000:2.0:1789136193.335224:0:25476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0600b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d8be90b6-0a63-4a05-9b5e-0fab1488262f+7:2397:x1876044567194880:12345-192.168.206.56@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1789136193.335397:0:25476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0600b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d8be90b6-0a63-4a05-9b5e-0fab1488262f+7:2397:x1876044567194880:12345-192.168.206.56@tcp:16:lhsmtool_posix.0 Request processed in 172us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136193.335406:0:25476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 23 00000100:00100000:1.0:1789136193.345183:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:3.0:1789136193.345458:0:26186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567195136 00000100:00100000:3.0:1789136193.345474:0:26186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567195136 00000100:00100000:3.0:1789136193.345581:0:26186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 69 00000100:00100000:3.0:1789136193.345595:0:26186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f429fa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d8be90b6-0a63-4a05-9b5e-0fab1488262f+14:19084:x1876044567195136:12345-192.168.206.56@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789136193.345699:0:26186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789136193.345738:0:26186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32c200/0xedd53ca6b6e47966 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a88 expref: 14 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136193.345762:0:26186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff949f42820200) 00010000:00010000:3.0:1789136193.345769:0:26186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789136193.345813:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32c600/0xedd53ca6b6e47974 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136193.345831:0:26186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32c600/0xedd53ca6b6e47974 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136193.345868:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32c600/0xedd53ca6b6e47974 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789136193.346027:0:26186:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000e16fbab8 reply state 00000000c2ebb141 transno 12884901919 ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32c600/0xedd53ca6b6e47974 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136193.346042:0:26186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32c600/0xedd53ca6b6e47974 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 26186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136193.346049:0:26186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff949f42820200) 00010000:00010000:3.0:1789136193.346053:0:26186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789136193.346056:0:26186:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789136193.346206:0:26186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f429fa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d8be90b6-0a63-4a05-9b5e-0fab1488262f+15:19084:x1876044567195136:12345-192.168.206.56@tcp:36:lhsmtool_posix.0 Request processed in 614us (1033us total) trans 12884901919 rc 0/0 00000100:00100000:3.0:1789136193.346215:0:26186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 69 00000100:00100000:0.0:1789136193.352693:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:2.0:1789136193.355207:0:24892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567195264 00000100:00100000:2.0:1789136193.355232:0:24892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567195264 00000100:00100000:2.0:1789136193.355330:0:24892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 24 00000100:00100000:2.0:1789136193.355343:0:24892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0556f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d8be90b6-0a63-4a05-9b5e-0fab1488262f+7:19084:x1876044567195264:12345-192.168.206.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789136193.355368:0:24892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789136193.355394:0:24892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e53fdf38/0xedd53ca6b6e4797b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x19d4d74b7ccf4a96 expref: -99 pid: 24892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136193.355436:0:24892:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004ba826a4/0xedd53ca6b6e4796d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a8f expref: 8 pid: 24892 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136193.355446:0:24892:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789136193.355451:0:24892:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789136193.355457:0:24892:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e53fdf38/0xedd53ca6b6e4797b lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a96 expref: 8 pid: 24892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136193.355507:0:24892:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004ba826a4/0xedd53ca6b6e4796d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a8f expref: 8 pid: 24892 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136193.355546:0:24892:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004ba826a4/0xedd53ca6b6e4796d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a8f expref: 8 pid: 24892 timeout: 831 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136193.355576:0:24892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07f9dd680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:24892:1876044587232640:192.168.206.56@tcp:104: 00000100:00100000:2.0:1789136193.355717:0:24892:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a049161e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789136193.363275:0:24892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07f9dd680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:24892:1876044587232640:192.168.206.56@tcp:104: 00010000:00010000:2.0:1789136193.363339:0:24892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e53fdf38/0xedd53ca6b6e4797b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a96 expref: 8 pid: 24892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136193.363370:0:24892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94a0773e9800, rc 0) 00000100:00100000:2.0:1789136193.363486:0:24892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0556f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d8be90b6-0a63-4a05-9b5e-0fab1488262f+8:19084:x1876044567195264:12345-192.168.206.56@tcp:101:lhsmtool_posix.0 Request processed in 8144us (10807us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136193.363498:0:24892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 24 00000100:00100000:1.0:1789136193.369121:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:0.0:1789136193.369281:0:23363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567195392 00000100:00100000:0.0:1789136193.369293:0:23363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567195392 00010000:00010000:0.0:1789136193.369353:0:23363:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004ba826a4/0xedd53ca6b6e4796d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a8f expref: 8 pid: 24892 timeout: 831 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136193.369438:0:23363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 20 00000100:00100000:0.0:1789136193.369451:0:23363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f429f9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d8be90b6-0a63-4a05-9b5e-0fab1488262f+8:2398:x1876044567195392:12345-192.168.206.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789136193.369472:0:23363:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789136193.369516:0:23363:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004ba826a4/0xedd53ca6b6e4796d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a8f expref: 8 pid: 24892 timeout: 831 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.369534:0:23363:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004ba826a4/0xedd53ca6b6e4796d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a8f expref: 8 pid: 24892 timeout: 831 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.369564:0:23363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ba826a4/0xedd53ca6b6e4796d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a8f expref: 8 pid: 24892 timeout: 831 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.369585:0:23363:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136193.369590:0:23363:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136193.369598:0:23363:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e53fdf38/0xedd53ca6b6e4797b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a96 expref: 7 pid: 24892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.369612:0:23363:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e53fdf38/0xedd53ca6b6e4797b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a96 expref: 7 pid: 24892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.369726:0:23363:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e53fdf38/0xedd53ca6b6e4797b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a96 expref: 7 pid: 24892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136193.369763:0:23363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a0556f9a40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:23363:1876044587232768:192.168.206.56@tcp:105: 00000100:00100000:0.0:1789136193.370300:0:23363:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a081af1cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789136193.387271:0:23363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a0556f9a40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:23363:1876044587232768:192.168.206.56@tcp:105: 00010000:00010000:2.0:1789136193.387312:0:23363:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789136193.387445:0:23363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f429f9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d8be90b6-0a63-4a05-9b5e-0fab1488262f+7:2398:x1876044567195392:12345-192.168.206.56@tcp:103:ldlm_bl.0 Request processed in 17996us (18350us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136193.387459:0:23363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 20 00000100:00100000:3.0:1789136193.399153:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:2.0:1789136193.399377:0:24895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567195520 00000100:00100000:2.0:1789136193.399391:0:24895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567195520 00000100:00100000:2.0:1789136193.399473:0:24895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 25 00000100:00100000:2.0:1789136193.399499:0:24895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a07f6e9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d8be90b6-0a63-4a05-9b5e-0fab1488262f+7:2398:x1876044567195520:12345-192.168.206.56@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789136193.400705:0:24895:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789136193.400735:0:24895:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1789136191 00002000:00010000:2.0:1789136193.400739:0:24895:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 1789136190 00002000:00010000:2.0:1789136193.400741:0:24895:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1789136192 -> 1789136191 00002000:00010000:2.0:1789136193.400743:0:24895:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1789136193.400831:0:24895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a07f6e9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d8be90b6-0a63-4a05-9b5e-0fab1488262f+8:2398:x1876044567195520:12345-192.168.206.56@tcp:2:lhsmtool_posix.0 Request processed in 1343us (1691us total) trans 12884901893 rc 0/0 00000100:00100000:2.0:1789136193.400843:0:24895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 25 00000100:00100000:1.0:1789136193.404337:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:0.0:1789136193.404499:0:25476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567195648 00000100:00100000:0.0:1789136193.404513:0:25476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567195648 00000100:00100000:0.0:1789136193.404592:0:25476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 26 00000100:00100000:0.0:1789136193.404604:0:25476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f429f9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d8be90b6-0a63-4a05-9b5e-0fab1488262f+8:2397:x1876044567195648:12345-192.168.206.56@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789136193.404713:0:25476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008fc1705c/0xedd53ca6b6e47982 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.404742:0:25476:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e53fdf38/0xedd53ca6b6e4797b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a96 expref: 8 pid: 24892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.404753:0:25476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136193.404759:0:25476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789136193.404764:0:25476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008fc1705c/0xedd53ca6b6e47982 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.404809:0:25476:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e53fdf38/0xedd53ca6b6e4797b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a96 expref: 8 pid: 24892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.404827:0:25476:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e53fdf38/0xedd53ca6b6e4797b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a96 expref: 8 pid: 24892 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136193.404844:0:25476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a0556fb0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:25476:1876044587232896:192.168.206.56@tcp:104: 00000100:00100000:0.0:1789136193.404966:0:25476:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a081af1300 going to sleep for 11 seconds 00000100:00100000:1.0:1789136193.410193:0:25476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a0556fb0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:25476:1876044587232896:192.168.206.56@tcp:104: 00010000:00010000:1.0:1789136193.410236:0:25476:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008fc1705c/0xedd53ca6b6e47982 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136193.414014:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:2.0:1789136193.415089:0:26438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567195776 00000100:00100000:2.0:1789136193.415123:0:26438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567195776 00010000:00010000:2.0:1789136193.415200:0:26438:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e53fdf38/0xedd53ca6b6e4797b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a96 expref: 9 pid: 24892 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136193.415263:0:26438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 21 00000100:00100000:2.0:1789136193.415275:0:26438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f429fad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d8be90b6-0a63-4a05-9b5e-0fab1488262f+9:2397:x1876044567195776:12345-192.168.206.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789136193.415296:0:26438:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789136193.415330:0:26438:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e53fdf38/0xedd53ca6b6e4797b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a96 expref: 9 pid: 24892 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136193.415348:0:26438:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e53fdf38/0xedd53ca6b6e4797b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a96 expref: 9 pid: 24892 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136193.415378:0:26438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e53fdf38/0xedd53ca6b6e4797b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a96 expref: 9 pid: 24892 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136193.415402:0:26438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789136193.415407:0:26438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789136193.415436:0:26438:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008fc1705c/0xedd53ca6b6e47982 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136193.415448:0:26438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008fc1705c/0xedd53ca6b6e47982 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.416185:0:25476:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008fc1705c/0xedd53ca6b6e47982 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.416200:0:25476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008fc1705c/0xedd53ca6b6e47982 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.416231:0:25476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008fc1705c/0xedd53ca6b6e47982 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.416240:0:25476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008fc1705c/0xedd53ca6b6e47982 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.416248:0:25476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008fc1705c/0xedd53ca6b6e47982 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.416255:0:25476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff949f43a19400 already unused, calling callback (ffffffffc0d90550) 00010000:00010000:0.0:1789136193.416260:0:25476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008fc1705c/0xedd53ca6b6e47982 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.416269:0:25476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008fc1705c/0xedd53ca6b6e47982 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.416285:0:25476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008fc1705c/0xedd53ca6b6e47982 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136193.416418:0:25476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f429f9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d8be90b6-0a63-4a05-9b5e-0fab1488262f+8:2397:x1876044567195648:12345-192.168.206.56@tcp:1:lhsmtool_posix.0 Request processed in 11812us (12093us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136193.416430:0:25476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 26 00010000:00010000:2.0:1789136193.416692:0:26438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008fc1705c/0xedd53ca6b6e47982 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136193.416722:0:26438:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789136193.416748:0:26438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f429fad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d8be90b6-0a63-4a05-9b5e-0fab1488262f+7:2397:x1876044567195776:12345-192.168.206.56@tcp:103:ldlm_bl.0 Request processed in 1475us (2751us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136193.416756:0:26438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 21 00000100:00100000:0.0:1789136193.427354:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:3.0:1789136193.427475:0:23379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567196032 00000100:00100000:3.0:1789136193.427501:0:23379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567196032 00000100:00100000:3.0:1789136193.427580:0:23379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 70 00000100:00100000:3.0:1789136193.427594:0:23379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0556fb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8be90b6-0a63-4a05-9b5e-0fab1488262f+15:19084:x1876044567196032:12345-192.168.206.56@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789136193.427759:0:23379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32c200/0xedd53ca6b6e47989 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136193.427779:0:23379:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18c00/0xedd53ca6b6e4785c lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a34 expref: 15 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136193.427789:0:23379:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32c200/0xedd53ca6b6e47989 lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136193.427854:0:23379:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18c00/0xedd53ca6b6e4785c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a34 expref: 15 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136193.427869:0:23379:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18c00/0xedd53ca6b6e4785c lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a34 expref: 15 pid: 23379 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136193.427886:0:23379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07f6eb0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:23379:1876044587233024:192.168.206.56@tcp:104: 00000100:00100000:3.0:1789136193.427993:0:23379:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a081ade480 going to sleep for 11 seconds 00000100:00100000:3.0:1789136193.434168:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:0.0:1789136193.434287:0:23364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567196160 00000100:00100000:0.0:1789136193.434301:0:23364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567196160 00010000:00010000:0.0:1789136193.434376:0:23364:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18c00/0xedd53ca6b6e4785c lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a34 expref: 16 pid: 23379 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136193.434434:0:23364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 22 00000100:00100000:0.0:1789136193.434445:0:23364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a07f6e92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d8be90b6-0a63-4a05-9b5e-0fab1488262f+16:2397:x1876044567196160:12345-192.168.206.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789136193.434465:0:23364:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789136193.434472:0:23364:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18c00/0xedd53ca6b6e4785c lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a34 expref: 16 pid: 23379 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.434487:0:23364:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18c00/0xedd53ca6b6e4785c lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a34 expref: 16 pid: 23379 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.434513:0:23364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff949f428ff400) 00010000:00010000:0.0:1789136193.434519:0:23364:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19c00/0xedd53ca6b6e478ef lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a65 expref: 16 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.434530:0:23364:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32c200/0xedd53ca6b6e47989 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.434538:0:23364:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32c200/0xedd53ca6b6e47989 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.434561:0:23364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32c200/0xedd53ca6b6e47989 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.434582:0:23364:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789136193.434681:0:23364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a07f6e92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d8be90b6-0a63-4a05-9b5e-0fab1488262f+16:2397:x1876044567196160:12345-192.168.206.56@tcp:103:ldlm_bl.0 Request processed in 237us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136193.434690:0:23364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 22 00010000:00010000:1.0:1789136193.440920:0:23379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18c00/0xedd53ca6b6e4785c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a34 expref: 15 pid: 23379 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136193.440955:0:23379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07f6eb0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:23379:1876044587233024:192.168.206.56@tcp:104: 00010000:00010000:1.0:1789136193.440990:0:23379:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32c200/0xedd53ca6b6e47989 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136193.441001:0:23379:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32c200/0xedd53ca6b6e47989 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136193.441008:0:23379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32c200/0xedd53ca6b6e47989 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136193.441321:0:23379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94a060037000/0xedd53ca6b6e47990 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136193.441338:0:23379:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19000/0xedd53ca6b6e47958 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a81 expref: 15 pid: 23378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136193.441348:0:23379:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94a060037000/0xedd53ca6b6e47990 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136193.441398:0:23379:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19000/0xedd53ca6b6e47958 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a81 expref: 15 pid: 23378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136193.441433:0:23379:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19000/0xedd53ca6b6e47958 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a81 expref: 15 pid: 23378 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136193.441452:0:23379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f429f8000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:23379:1876044587233152:192.168.206.56@tcp:104: 00000100:00100000:1.0:1789136193.441586:0:23379:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a05020dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789136193.445034:0:23379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f429f8000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:23379:1876044587233152:192.168.206.56@tcp:104: 00010000:00010000:1.0:1789136193.445072:0:23379:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94a060037000/0xedd53ca6b6e47990 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136193.454868:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:1.0:1789136193.454991:0:23365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567196288 00000100:00100000:1.0:1789136193.455005:0:23365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567196288 00010000:00010000:1.0:1789136193.455058:0:23365:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19000/0xedd53ca6b6e47958 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a81 expref: 16 pid: 23378 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136193.455102:0:23365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 23 00000100:00100000:1.0:1789136193.455122:0:23365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a043c6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d8be90b6-0a63-4a05-9b5e-0fab1488262f+16:2398:x1876044567196288:12345-192.168.206.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789136193.455141:0:23365:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789136193.455149:0:23365:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19000/0xedd53ca6b6e47958 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a81 expref: 16 pid: 23378 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136193.455166:0:23365:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19000/0xedd53ca6b6e47958 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a81 expref: 16 pid: 23378 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136193.455194:0:23365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19000/0xedd53ca6b6e47958 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a81 expref: 16 pid: 23378 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136193.455239:0:23365:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff949f42820200) 00010000:00010000:1.0:1789136193.455245:0:23365:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94a060037000/0xedd53ca6b6e47990 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136193.455256:0:23365:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94a060037000/0xedd53ca6b6e47990 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136193.455265:0:23365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94a060037000/0xedd53ca6b6e47990 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136193.455300:0:23365:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789136193.455364:0:23365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a043c6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d8be90b6-0a63-4a05-9b5e-0fab1488262f+15:2398:x1876044567196288:12345-192.168.206.56@tcp:103:ldlm_bl.0 Request processed in 253us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136193.455372:0:23365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 23 00010000:00010000:3.0:1789136193.455875:0:23379:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94a060037000/0xedd53ca6b6e47990 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136193.455892:0:23379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94a060037000/0xedd53ca6b6e47990 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789136193.456389:0:23379:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901920 00000001:00080000:2.0:1789136193.460745:0:23379:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901921 00000001:00080000:2.0:1789136193.460844:0:23379:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901922 00000100:00100000:2.0:1789136193.460948:0:23379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07f9dd680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:23379:1876044587233280:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789136193.461015:0:23379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136193.461241:0:23379:0:(client.c:2715:ptlrpc_set_wait()) set ffff949f429dd480 going to sleep for 11 seconds 00000100:00100000:1.0:1789136193.461589:0:23384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587233280 00000100:00100000:1.0:1789136193.461606:0:23384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587233280 00000100:00100000:1.0:1789136193.461725:0:23384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789136193.461737:0:23384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a07f9dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:23379:x1876044587233280:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789136193.461920:0:23384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a07f9dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:23379:x1876044587233280:12345-0@lo:1000:mdt00_001.0 Request processed in 185us (904us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136193.461928:0:23384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789136193.462177:0:23379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07f9dd680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:23379:1876044587233280:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1789136193.462573:0:23379:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901923 00000100:00100000:3.0:1789136193.464656:0:23379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07f6ea940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:23379:1876044587233408:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789136193.464829:0:23379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136193.464883:0:23379:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a049161180 going to sleep for 11 seconds 00000100:00100000:1.0:1789136193.464959:0:24123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587233408 00000100:00100000:1.0:1789136193.464970:0:24123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587233408 00000100:00100000:1.0:1789136193.465038:0:24123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789136193.465049:0:24123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0556fa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:23379:x1876044587233408:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789136193.465283:0:24123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0556fa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:23379:x1876044587233408:12345-0@lo:1000:mdt00_001.0 Request processed in 236us (460us total) trans 12884901894 rc 0/0 00000100:00100000:1.0:1789136193.465311:0:24123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789136193.465418:0:23379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07f6ea940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:23379:1876044587233408:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1789136193.465476:0:23379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94a060037000/0xedd53ca6b6e47990 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.465487:0:23379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94a060037000/0xedd53ca6b6e47990 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.465495:0:23379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94a060037000/0xedd53ca6b6e47990 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.465502:0:23379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a060037000 already unused, calling callback (ffffffffc19d34f0) 00010000:00010000:0.0:1789136193.465507:0:23379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94a060037000/0xedd53ca6b6e47990 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.465515:0:23379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94a060037000/0xedd53ca6b6e47990 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.465534:0:23379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff949f42820200) 00010000:00010000:0.0:1789136193.465537:0:23379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789136193.465542:0:23379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94a060037000/0xedd53ca6b6e47990 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.465557:0:23379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94a060037000/0xedd53ca6b6e47990 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.465597:0:23379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8600/0xedd53ca6b6e478e8 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 23380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.465605:0:23379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8600/0xedd53ca6b6e478e8 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 23380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.465611:0:23379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8600/0xedd53ca6b6e478e8 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 23380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.465616:0:23379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a0773e8600 already unused, calling callback (ffffffffc19d34f0) 00010000:00010000:0.0:1789136193.465619:0:23379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8600/0xedd53ca6b6e478e8 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 23380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.465625:0:23379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8600/0xedd53ca6b6e478e8 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 23380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.465660:0:23379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff949f428ff400) 00010000:00010000:0.0:1789136193.465663:0:23379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789136193.465672:0:23379:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19c00/0xedd53ca6b6e478ef lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a65 expref: 18 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.465683:0:23379:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19c00/0xedd53ca6b6e478ef lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a65 expref: 18 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.465692:0:23379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19c00/0xedd53ca6b6e478ef lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a65 expref: 18 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.465770:0:23379:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19c00/0xedd53ca6b6e478ef lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a65 expref: 18 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136193.465786:0:23379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a0556f92c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:23379:1876044587233536:192.168.206.56@tcp:105: 00000100:00100000:0.0:1789136193.465866:0:23379:0:(client.c:2715:ptlrpc_set_wait()) set ffff94a081af1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789136193.469332:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:0.0:1789136193.469450:0:23379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a0556f92c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:23379:1876044587233536:192.168.206.56@tcp:105: 00010000:00010000:0.0:1789136193.469477:0:23379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8600/0xedd53ca6b6e478e8 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 23380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.469487:0:23379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e8600/0xedd53ca6b6e478e8 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 23380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.469522:0:23379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18200/0xedd53ca6b6e47997 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136193.469524:0:23381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567196416 00000100:00100000:3.0:1789136193.469534:0:23381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567196416 00010000:00010000:0.0:1789136193.469538:0:23379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18200/0xedd53ca6b6e47997 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.469551:0:23379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18200/0xedd53ca6b6e47997 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.469559:0:23379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18200/0xedd53ca6b6e47997 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.469566:0:23379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18200/0xedd53ca6b6e47997 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.469572:0:23379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18200/0xedd53ca6b6e47997 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.469600:0:23379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff949f43a18200 already unused, calling callback (ffffffffc19d34f0) 00010000:00010000:0.0:1789136193.469604:0:23379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18200/0xedd53ca6b6e47997 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.469611:0:23379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18200/0xedd53ca6b6e47997 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.469624:0:23379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff949f428ff400) 00010000:00010000:0.0:1789136193.469667:0:23379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789136193.469672:0:23379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18200/0xedd53ca6b6e47997 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136193.469680:0:23381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 12 00010000:00010000:0.0:1789136193.469681:0:23379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18200/0xedd53ca6b6e47997 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136193.469701:0:23381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a07f9dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d8be90b6-0a63-4a05-9b5e-0fab1488262f+19:19083:x1876044567196416:12345-192.168.206.56@tcp:49:bash.0 00010000:00010000:0.0:1789136193.469701:0:23379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32c200/0xedd53ca6b6e47989 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.469713:0:23379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32c200/0xedd53ca6b6e47989 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.469720:0:23379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32c200/0xedd53ca6b6e47989 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.469725:0:23379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a07a32c200 already unused, calling callback (ffffffffc19d34f0) 00010000:00010000:0.0:1789136193.469728:0:23379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32c200/0xedd53ca6b6e47989 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.469736:0:23379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32c200/0xedd53ca6b6e47989 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.469757:0:23379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff949f428ff400) 00010000:00010000:0.0:1789136193.469760:0:23379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789136193.469763:0:23379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32c200/0xedd53ca6b6e47989 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.469769:0:23379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94a07a32c200/0xedd53ca6b6e47989 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136193.469849:0:23381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a07f9dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d8be90b6-0a63-4a05-9b5e-0fab1488262f+19:19083:x1876044567196416:12345-192.168.206.56@tcp:49:bash.0 Request processed in 155us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136193.469859:0:23381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 12 00000100:00100000:0.0:1789136193.469906:0:23379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0556fb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8be90b6-0a63-4a05-9b5e-0fab1488262f+18:19084:x1876044567196032:12345-192.168.206.56@tcp:57:lhsmtool_posix.0 Request processed in 42315us (42566us total) trans 12884901924 rc 0/0 00000100:00100000:0.0:1789136193.469915:0:23379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 70 00000020:00080000:0.0:1789136193.469919:0:23379:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1789136193.469990:0:23417:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1789136193.470000:0:23417:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789136193.470041:0:23417:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:1.0:1789136193.470048:0:23417:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1789136193.475922:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:3.0:1789136193.475966:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:1.0:1789136193.476047:0:24892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567196800 00000100:00100000:1.0:1789136193.476063:0:24892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567196800 00000100:00100000:1.0:1789136193.476160:0:24892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 27 00000100:00100000:1.0:1789136193.476173:0:24892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a07f6eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d8be90b6-0a63-4a05-9b5e-0fab1488262f+7:19083:x1876044567196800:12345-192.168.206.56@tcp:101:bash.0 00010000:00010000:1.0:1789136193.476199:0:24892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789136193.476227:0:24892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007278c9a9/0xedd53ca6b6e4799e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x19d4d74b7ccf4a9d expref: -99 pid: 24892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789136193.476261:0:24892:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x6aa40d3f, atime: 0x6aa40d3e, ctime: 0x6aa40d3f, blocks: 0x0 00010000:00010000:1.0:1789136193.476288:0:24892:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=731s v=(0 0) 00010000:00010000:1.0:1789136193.476294:0:24892:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789136193.476306:0:24892:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007278c9a9/0xedd53ca6b6e4799e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a9d expref: 8 pid: 24892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136193.476326:0:24892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007278c9a9/0xedd53ca6b6e4799e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4a9d expref: 8 pid: 24892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136193.476341:0:24892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94a060036a00, rc 0) 00000100:00100000:1.0:1789136193.476429:0:24892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a07f6eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d8be90b6-0a63-4a05-9b5e-0fab1488262f+8:19083:x1876044567196800:12345-192.168.206.56@tcp:101:bash.0 Request processed in 259us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136193.476436:0:24892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 27 00000100:00100000:2.0:1789136193.476536:0:23382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567196672 00000100:00100000:2.0:1789136193.476548:0:23382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567196672 00000100:00100000:2.0:1789136193.476661:0:23382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 13 00000100:00100000:2.0:1789136193.476675:0:23382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a07f6e92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d8be90b6-0a63-4a05-9b5e-0fab1488262f+18:19084:x1876044567196672:12345-192.168.206.56@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789136193.476962:0:23382:0:(mdd_object.c:4024:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789136193.477007:0:23382:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901925 00010000:00010000:2.0:1789136193.477042:0:23382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9e00/0xedd53ca6b6e479a5 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136193.477070:0:23382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9e00/0xedd53ca6b6e479a5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 23382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136193.477082:0:23382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9e00/0xedd53ca6b6e479a5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 23382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136193.477091:0:23382:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9e00/0xedd53ca6b6e479a5 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 23382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136193.477097:0:23382:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9e00/0xedd53ca6b6e479a5 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 23382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136193.477102:0:23382:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9e00/0xedd53ca6b6e479a5 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 23382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136193.477132:0:23382:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789136193.477175:0:23366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789136193.477185:0:23366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9e00/0xedd53ca6b6e479a5 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 23382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136193.477196:0:23366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94a0773e9e00 already unused, calling callback (ffffffffc0d90550) 00010000:00010000:1.0:1789136193.477201:0:23366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9e00/0xedd53ca6b6e479a5 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 23382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136193.477212:0:23366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9e00/0xedd53ca6b6e479a5 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 23382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136193.477229:0:23366:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff949f42820200) 00010000:00010000:1.0:1789136193.477232:0:23366:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789136193.477248:0:23366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9e00/0xedd53ca6b6e479a5 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 23382 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136193.477250:0:23382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a07f6e92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d8be90b6-0a63-4a05-9b5e-0fab1488262f+20:19084:x1876044567196672:12345-192.168.206.56@tcp:35:lhsmtool_posix.0 Request processed in 575us (1333us total) trans 12884901926 rc 0/0 00010000:00010000:1.0:1789136193.477276:0:23366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94a0773e9e00/0xedd53ca6b6e479a5 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 23382 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136193.477283:0:23382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 13 00000020:00080000:2.0:1789136193.477297:0:23382:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789136193.477311:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136193.477315:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136193.477317:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136193.484771:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:1.0:1789136193.484859:0:23380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567196928 00000100:00100000:1.0:1789136193.484874:0:23380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567196928 00000100:00100000:1.0:1789136193.484960:0:23380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 71 00000100:00100000:1.0:1789136193.484972:0:23380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f42b1fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8be90b6-0a63-4a05-9b5e-0fab1488262f+20:19083:x1876044567196928:12345-192.168.206.56@tcp:101:bash.0 00010000:00010000:1.0:1789136193.484997:0:23380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789136193.485024:0:23380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94a060037200/0xedd53ca6b6e479ac lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19d4d74b7ccf4aa4 expref: -99 pid: 23380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136193.485066:0:23380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94a060036400/0xedd53ca6b6e479b3 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136193.485099:0:23380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94a060036400/0xedd53ca6b6e479b3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136193.485125:0:23380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94a060036400/0xedd53ca6b6e479b3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136193.485270:0:23380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94a060037200/0xedd53ca6b6e479ac lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4aa4 expref: 22 pid: 23380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136193.485290:0:23380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94a060036400/0xedd53ca6b6e479b3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4aa4 expref: 21 pid: 23380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136193.485299:0:23380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff949f428ff400) 00010000:00010000:1.0:1789136193.485302:0:23380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789136193.485307:0:23380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94a060036400, rc 0) 00000100:00100000:1.0:1789136193.485388:0:23380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f42b1fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8be90b6-0a63-4a05-9b5e-0fab1488262f+21:19083:x1876044567196928:12345-192.168.206.56@tcp:101:bash.0 Request processed in 418us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136193.485396:0:23380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 71 00000100:00100000:3.0:1789136193.489776:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:2.0:1789136193.491245:0:23382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567197184 00000100:00100000:2.0:1789136193.491259:0:23382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567197184 00000100:00100000:0.0:1789136193.491499:0:23382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 14 00000100:00100000:0.0:1789136193.491510:0:23382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f42b1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d8be90b6-0a63-4a05-9b5e-0fab1488262f+21:19083:x1876044567197184:12345-192.168.206.56@tcp:35:bash.0 00000001:00080000:0.0:1789136193.491750:0:23382:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901927 00000001:00080000:0.0:1789136193.491848:0:23382:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901928 00000100:00100000:0.0:1789136193.492511:0:23382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f42b1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d8be90b6-0a63-4a05-9b5e-0fab1488262f+24:19083:x1876044567197184:12345-192.168.206.56@tcp:35:bash.0 Request processed in 999us (2740us total) trans 12884901929 rc 0/0 00000100:00100000:0.0:1789136193.492522:0:23382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 14 00000020:00080000:0.0:1789136193.492527:0:23382:0:(tgt_main.c:785:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1789136193.662705:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:0.0:1789136193.662830:0:23378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567197440 00000100:00100000:0.0:1789136193.662841:0:23378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567197440 00000100:00100000:0.0:1789136193.662905:0:23378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 72 00000100:00100000:0.0:1789136193.662916:0:23378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f440bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8be90b6-0a63-4a05-9b5e-0fab1488262f+24:19094:x1876044567197440:12345-192.168.206.56@tcp:101:lfs.0 00010000:00010000:0.0:1789136193.662939:0:23378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136193.662971:0:23378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18200/0xedd53ca6b6e479ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x19d4d74b7ccf4aab expref: -99 pid: 23378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789136193.663087:0:23378:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789136193.663203:0:23378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18200/0xedd53ca6b6e479ba lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4aab expref: 26 pid: 23378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.663230:0:23378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff949f428ff000) 00010000:00010000:0.0:1789136193.663233:0:23378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789136193.663239:0:23378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18200/0xedd53ca6b6e479ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.56@tcp remote: 0x19d4d74b7ccf4aab expref: 26 pid: 23378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.663253:0:23378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff949f43a18200, rc 0) 00000100:00100000:0.0:1789136193.663326:0:23378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f440bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8be90b6-0a63-4a05-9b5e-0fab1488262f+25:19094:x1876044567197440:12345-192.168.206.56@tcp:101:lfs.0 Request processed in 411us (630us total) trans 12884901930 rc 301/301 00000100:00100000:0.0:1789136193.663333:0:23378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 72 00000100:00100000:1.0:1789136193.669226:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:0.0:1789136193.669298:0:23379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567197568 00000100:00100000:0.0:1789136193.669306:0:23379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567197568 00000100:00100000:0.0:1789136193.669366:0:23379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 73 00000100:00100000:0.0:1789136193.669376:0:23379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f429f9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8be90b6-0a63-4a05-9b5e-0fab1488262f+25:19094:x1876044567197568:12345-192.168.206.56@tcp:34:lfs.0 00010000:00010000:0.0:1789136193.669463:0:23379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19000/0xedd53ca6b6e479c8 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.669480:0:23379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19000/0xedd53ca6b6e479c8 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.669491:0:23379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19000/0xedd53ca6b6e479c8 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.669506:0:23379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18c00/0xedd53ca6b6e479cf lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.669527:0:23379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18c00/0xedd53ca6b6e479cf lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.669533:0:23379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18c00/0xedd53ca6b6e479cf lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.669596:0:23379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19400/0xedd53ca6b6e479d6 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.669610:0:23379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19400/0xedd53ca6b6e479d6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.669617:0:23379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19400/0xedd53ca6b6e479d6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789136193.669683:0:23379:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19400/0xedd53ca6b6e479d6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.669694:0:23379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19000/0xedd53ca6b6e479c8 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.669701:0:23379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19000/0xedd53ca6b6e479c8 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.669707:0:23379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19000/0xedd53ca6b6e479c8 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.669713:0:23379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff949f43a19000 already unused, calling callback (ffffffffc19d34f0) 00010000:00010000:0.0:1789136193.669717:0:23379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19000/0xedd53ca6b6e479c8 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.669723:0:23379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19000/0xedd53ca6b6e479c8 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.669741:0:23379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff94a0490dfd00) 00010000:00010000:0.0:1789136193.669744:0:23379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789136193.669749:0:23379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19000/0xedd53ca6b6e479c8 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.669756:0:23379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19000/0xedd53ca6b6e479c8 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.669767:0:23379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18c00/0xedd53ca6b6e479cf lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.669773:0:23379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18c00/0xedd53ca6b6e479cf lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.669779:0:23379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18c00/0xedd53ca6b6e479cf lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.669784:0:23379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff949f43a18c00 already unused, calling callback (ffffffffc19d34f0) 00010000:00010000:0.0:1789136193.669786:0:23379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18c00/0xedd53ca6b6e479cf lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.669792:0:23379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18c00/0xedd53ca6b6e479cf lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.670038:0:23379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff949f428ffb00) 00010000:00010000:0.0:1789136193.670042:0:23379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789136193.670045:0:23379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18c00/0xedd53ca6b6e479cf lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.670051:0:23379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a18c00/0xedd53ca6b6e479cf lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.670076:0:23379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19400/0xedd53ca6b6e479d6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.670082:0:23379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19400/0xedd53ca6b6e479d6 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.670087:0:23379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19400/0xedd53ca6b6e479d6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.670092:0:23379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff949f43a19400 already unused, calling callback (ffffffffc19d34f0) 00010000:00010000:0.0:1789136193.670095:0:23379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19400/0xedd53ca6b6e479d6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.670101:0:23379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19400/0xedd53ca6b6e479d6 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.670117:0:23379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff949f428ff400) 00010000:00010000:0.0:1789136193.670120:0:23379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789136193.670123:0:23379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19400/0xedd53ca6b6e479d6 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136193.670129:0:23379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff949f43a19400/0xedd53ca6b6e479d6 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136193.670256:0:23379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f429f9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8be90b6-0a63-4a05-9b5e-0fab1488262f+25:19094:x1876044567197568:12345-192.168.206.56@tcp:34:lfs.0 Request processed in 880us (1049us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136193.670265:0:23379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 73 00000100:00100000:2.0:1789136193.672734:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:3.0:1789136193.672909:0:23381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567197824 00000100:00100000:3.0:1789136193.672916:0:23381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567197824 00000100:00100000:3.0:1789136193.672970:0:23381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 15 00000100:00100000:3.0:1789136193.672979:0:23381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a07f9df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d8be90b6-0a63-4a05-9b5e-0fab1488262f+25:19094:x1876044567197824:12345-192.168.206.56@tcp:35:lfs.0 00000100:00100000:3.0:1789136193.673201:0:23381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a07f9df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d8be90b6-0a63-4a05-9b5e-0fab1488262f+26:19094:x1876044567197824:12345-192.168.206.56@tcp:35:lfs.0 Request processed in 222us (473us total) trans 12884901931 rc 0/0 00000100:00100000:3.0:1789136193.673499:0:23381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 15 00010000:00010000:3.0:1789136193.840856:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136194.865858:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789136195.391319:0:26475:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: /mnt/lustre/d1d.sanity-pcc/f1d.sanity-pcc expected pcc state: readwrite, but got: none 00010000:00010000:3.0:1789136195.889019:0:23367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136196.332794:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:3.0:1789136196.332847:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.56@tcp (source: 12345-192.168.206.56@tcp) 00000100:00100000:1.0:1789136196.332982:0:24898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567197952 00000100:00100000:1.0:1789136196.332992:0:24898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567197952 00002000:00100000:1.0:1789136196.333169:0:24898:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x42:0x0] (0->8) req@ffff949f440bcb40 x1876044567197952/t0(0) o4->d8be90b6-0a63-4a05-9b5e-0fab1488262f@192.168.206.56@tcp:627/0 lens 504/0 e 0 to 0 dl 1789136207 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1789136196.333182:0:24898:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff949f440bcb40 with x1876044567197952 ext(0->8) 00002000:00010000:1.0:1789136196.333188:0:24898:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff949f440bcb40 00000100:00100000:1.0:1789136196.333220:0:24898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 0 00000100:00100000:1.0:1789136196.333244:0:24898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f440bcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d8be90b6-0a63-4a05-9b5e-0fab1488262f+8:2395:x1876044567197952:12345-192.168.206.56@tcp:4:bash.0 00000100:00080000:3.0:1789136196.334128:0:23374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789136196.335471:0:24898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f440bcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d8be90b6-0a63-4a05-9b5e-0fab1488262f+10:2395:x1876044567197952:12345-192.168.206.56@tcp:4:bash.0 Request processed in 2222us (2680us total) trans 12884901895 rc 0/0 00000100:00100000:1.0:1789136196.335484:0:24898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 0 00002000:00100000:1.0:1789136196.335495:0:24898:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x42:0x0] (0->8) req@ffff949f440bcb40 x1876044567197952/t12884901895(0) o4->d8be90b6-0a63-4a05-9b5e-0fab1488262f@192.168.206.56@tcp:627/0 lens 504/448 e 0 to 0 dl 1789136207 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1789136196.335505:0:24898:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff949f440bcb40 with x1876044567197952 ext(0->8) 00002000:00010000:1.0:1789136196.335511:0:24898:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff949f440bcb40 00000100:00100000:2.0:1789136196.336486:0:24894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044567198080 00000100:00100000:2.0:1789136196.336497:0:24894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044567198080 00000100:00100000:2.0:1789136196.336554:0:24894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.56@tcp, seq: 28 00000100:00100000:2.0:1789136196.336567:0:24894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f440bfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d8be90b6-0a63-4a05-9b5e-0fab1488262f+10:2395:x1876044567198080:12345-192.168.206.56@tcp:16:kworker.0 00000001:00080000:0.0:1789136196.338598:0:25711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901895 is committed 00000001:00080000:0.0:1789136196.338615:0:25711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901894 is committed 00000100:00100000:2.0:1789136196.338864:0:24894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f440bfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d8be90b6-0a63-4a05-9b5e-0fab1488262f+6:2395:x1876044567198080:12345-192.168.206.56@tcp:16:kworker.0 Request processed in 2296us (6012us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136196.338888:0:24894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.56@tcp, seq: 28 00000100:00100000:1.0:1789136196.592814:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789136196.592828:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f440bf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876044587233792:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789136196.592832:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f429f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876044587233664:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789136196.597212:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136196.597266:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789136196.597278:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07f9dde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876044587233920:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789136196.597317:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136196.597570:0:24896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587233920 00000100:00100000:2.0:1789136196.597578:0:24896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587233920 00000100:00100000:2.0:1789136196.597656:0:24896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789136196.597668:0:24896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f440be940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876044587233920:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789136196.597699:0:24896:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915845632 avail 3684323328 00000100:00100000:2.0:1789136196.597743:0:24896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f440be940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876044587233920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136196.597751:0:24896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789136196.598157:0:23383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587233792 00000100:00100000:3.0:1789136196.598164:0:23383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587233792 00000100:00100000:3.0:1789136196.598207:0:23383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789136196.598215:0:23383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f440be1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876044587233792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789136196.598253:0:23383:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:3.0:1789136196.598292:0:23383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f440be1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876044587233792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (1085us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136196.598299:0:23383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:3.0:1789136196.598318:0:23374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789136196.598567:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07f9dde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876044587233920:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789136196.598589:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f440bf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876044587233792:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789136196.599797:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136196.599939:0:23384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587233664 00000100:00100000:2.0:1789136196.600161:0:23384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587233664 00000100:00100000:2.0:1789136196.600271:0:23384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789136196.600281:0:23384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a04373e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876044587233664:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789136196.600311:0:23384:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789136196.600393:0:23384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a04373e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876044587233664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 113us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136196.600400:0:23384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789136196.600481:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f429f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876044587233664:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789136196.918902:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136197.105321:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f440bf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3644072c-bb98-4fbe-9eaf-e40d57d161d0:3645:1876044587234048:0@lo:400:kworker.0 00000100:00100000:3.0:1789136197.105391:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136197.105429:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f440bd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876044587234560:0@lo:400:kworker.0 00000100:00100000:3.0:1789136197.105452:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136197.105470:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f440bd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876044587235072:0@lo:400:kworker.0 00000100:00100000:3.0:1789136197.105488:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136197.105504:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f448ff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876044587235584:0@lo:400:kworker.0 00000100:00100000:3.0:1789136197.105525:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136197.105548:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1789136197.105554:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f440bc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876044587234176:0@lo:400:kworker.0 00000100:00100000:3.0:1789136197.105577:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136197.105593:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f440bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876044587234688:0@lo:400:kworker.0 00000100:00100000:3.0:1789136197.105611:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136197.105652:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f440bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876044587235200:0@lo:400:kworker.0 00000100:00100000:3.0:1789136197.105673:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136197.105687:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f448fe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876044587235712:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789136197.105716:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136197.105742:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f440bda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876044587234304:0@lo:400:kworker.0 00000100:00100000:3.0:1789136197.105780:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136197.105799:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f440be580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876044587234816:0@lo:400:kworker.0 00000100:00100000:3.0:1789136197.105822:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136197.105838:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f440bed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876044587235328:0@lo:400:kworker.0 00000100:00100000:3.0:1789136197.105856:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136197.105873:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789136197.105878:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f440bcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876044587234432:0@lo:400:kworker.0 00000100:00100000:3.0:1789136197.105897:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136197.105912:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f440bde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876044587234944:0@lo:400:kworker.0 00000100:00100000:3.0:1789136197.105928:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136197.105942:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f440bc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876044587235456:0@lo:400:kworker.0 00000100:00100000:3.0:1789136197.105958:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136197.105979:0:23371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587234048 00000100:00100000:3.0:1789136197.105985:0:23371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587234048 00000100:00100000:3.0:1789136197.106026:0:23371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789136197.106035:0:23371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a0769c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+24:3645:x1876044587234048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136197.106083:0:23371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a0769c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3644072c-bb98-4fbe-9eaf-e40d57d161d0+24:3645:x1876044587234048:12345-0@lo:400:kworker.0 Request processed in 49us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136197.106107:0:23371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789136197.106141:0:23380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587234560 00000100:00100000:3.0:1789136197.106144:0:23380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587234560 00000100:00100000:3.0:1789136197.106165:0:23380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587235072 00000100:00100000:3.0:1789136197.106167:0:23380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587235072 00000100:00100000:3.0:1789136197.106179:0:23380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587235584 00000100:00100000:3.0:1789136197.106188:0:23380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587235584 00000100:00100000:3.0:1789136197.106212:0:23380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587235200 00000100:00100000:3.0:1789136197.106215:0:23380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587235200 00000100:00100000:3.0:1789136197.106227:0:23380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587235328 00000100:00100000:3.0:1789136197.106229:0:23380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587235328 00000100:00100000:3.0:1789136197.106240:0:23380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587235456 00000100:00100000:3.0:1789136197.106242:0:23380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587235456 00000100:00100000:3.0:1789136197.106253:0:23380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789136197.106259:0:23380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f448fe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876044587234560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136197.106290:0:23380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f448fe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876044587234560:12345-0@lo:400:kworker.0 Request processed in 31us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136197.106296:0:23380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789136197.106306:0:23380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789136197.106311:0:23380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f448fcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876044587235072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136197.106333:0:23380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f448fcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876044587235072:12345-0@lo:400:kworker.0 Request processed in 22us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136197.106338:0:23380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789136197.106346:0:23380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789136197.106351:0:23380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f448fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876044587235584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136197.106372:0:23380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f448fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876044587235584:12345-0@lo:400:kworker.0 Request processed in 21us (847us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136197.106377:0:23380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789136197.106386:0:23380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789136197.106390:0:23380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f448fe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876044587235200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136197.106410:0:23380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f448fe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876044587235200:12345-0@lo:400:kworker.0 Request processed in 19us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136197.106415:0:23380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789136197.106431:0:23380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789136197.106435:0:23380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f448ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876044587235328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136197.106462:0:23380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f448ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876044587235328:12345-0@lo:400:kworker.0 Request processed in 27us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136197.106467:0:23380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789136197.106476:0:23380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789136197.106481:0:23380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f448fda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876044587235456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136197.106500:0:23380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f448fda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876044587235456:12345-0@lo:400:kworker.0 Request processed in 20us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136197.106506:0:23380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789136197.106530:0:24123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587234176 00000100:00100000:3.0:1789136197.106533:0:24123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587234176 00000100:00100000:3.0:1789136197.106555:0:24123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587234688 00000100:00100000:3.0:1789136197.106558:0:24123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587234688 00000100:00100000:3.0:1789136197.106569:0:24123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789136197.106575:0:24123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f448ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876044587234176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136197.106606:0:24123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f448ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876044587234176:12345-0@lo:400:kworker.0 Request processed in 31us (1028us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136197.106611:0:24123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789136197.106622:0:24123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789136197.106652:0:24123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f448fc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876044587234688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136197.106677:0:24123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f448fc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876044587234688:12345-0@lo:400:kworker.0 Request processed in 50us (1065us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136197.106682:0:24123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789136197.106703:0:24896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587235712 00000100:00100000:3.0:1789136197.106706:0:24896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587235712 00000100:00100000:3.0:1789136197.106730:0:24896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789136197.106742:0:24896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f448fd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876044587235712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789136197.106756:0:24896:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915845632 avail 3684323328 00000100:00100000:3.0:1789136197.106787:0:24896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f448fd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876044587235712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 45us (1070us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136197.106793:0:24896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789136197.106810:0:25476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587234304 00000100:00100000:3.0:1789136197.106813:0:25476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587234304 00000100:00100000:3.0:1789136197.106835:0:25476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587234816 00000100:00100000:3.0:1789136197.106837:0:25476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587234816 00000100:00100000:3.0:1789136197.106847:0:25476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587234432 00000100:00100000:3.0:1789136197.106849:0:25476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587234432 00000100:00100000:3.0:1789136197.106862:0:25476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587234944 00000100:00100000:3.0:1789136197.106865:0:25476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587234944 00000100:00100000:3.0:1789136197.106877:0:25476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789136197.106883:0:25476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f448fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1876044587234304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136197.106911:0:25476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f448fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1876044587234304:12345-0@lo:400:kworker.0 Request processed in 28us (1131us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136197.106917:0:25476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789136197.106926:0:25476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789136197.106931:0:25476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f448fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876044587234816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136197.106951:0:25476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f448fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876044587234816:12345-0@lo:400:kworker.0 Request processed in 21us (1129us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136197.106956:0:25476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789136197.106964:0:25476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789136197.106968:0:25476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f448fde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1876044587234432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136197.106988:0:25476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f448fde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1876044587234432:12345-0@lo:400:kworker.0 Request processed in 19us (1090us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136197.107002:0:25476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789136197.107013:0:25476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789136197.107018:0:25476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f448fcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876044587234944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136197.107045:0:25476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f448fcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876044587234944:12345-0@lo:400:kworker.0 Request processed in 28us (1116us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136197.107050:0:25476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1789136197.107083:0:23374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789136197.107086:0:23374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789136197.107088:0:23374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789136197.107107:0:23374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789136197.107141:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901894 gen 2 00000004:00080000:3.0:1789136197.107147:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94a07f6e8b40, transno 12884901892 00000004:00080000:3.0:1789136197.107157:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901894 committed transno 12884901894 00000100:00100000:3.0:1789136197.107178:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f440bcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876044587234432:0@lo:400:kworker.0 00000100:00100000:3.0:1789136197.107190:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f440bde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876044587234944:0@lo:400:kworker.0 00000100:00100000:3.0:1789136197.107197:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f440bc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876044587235456:0@lo:400:kworker.0 00000100:00100000:3.0:1789136197.107205:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f440bda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876044587234304:0@lo:400:kworker.0 00000100:00100000:3.0:1789136197.107212:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f440be580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876044587234816:0@lo:400:kworker.0 00010000:00080000:3.0:1789136197.107221:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff949f440bed00 x1876044587235328/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136213 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136197.107230:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f440bed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876044587235328:0@lo:400:kworker.0 00000100:00100000:3.0:1789136197.107341:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f440bc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876044587234176:0@lo:400:kworker.0 00000100:00100000:3.0:1789136197.107351:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f440bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876044587234688:0@lo:400:kworker.0 00000100:00100000:3.0:1789136197.107368:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f440bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876044587235200:0@lo:400:kworker.0 00000100:00100000:3.0:1789136197.107381:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f448fe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876044587235712:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789136197.107389:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f440bf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3644072c-bb98-4fbe-9eaf-e40d57d161d0:3645:1876044587234048:0@lo:400:kworker.0 00000100:00100000:3.0:1789136197.107398:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f440bd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876044587234560:0@lo:400:kworker.0 00000100:00100000:3.0:1789136197.107406:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f440bd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876044587235072:0@lo:400:kworker.0 00010000:00080000:3.0:1789136197.107415:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff949f448ff840 x1876044587235584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136213 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136197.107423:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f448ff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876044587235584:0@lo:400:kworker.0 00000100:00100000:2.0:1789136197.108243:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789136197.108256:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94a07f9dcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876044587235840:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789136197.108301:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136197.109445:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff949f4401c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876044587235968:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789136197.109492:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136197.109541:0:24897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587235840 00000100:00100000:1.0:1789136197.109547:0:24897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587235840 00000100:00100000:1.0:1789136197.109579:0:24897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044587235968 00000100:00100000:1.0:1789136197.109582:0:24897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044587235968 00000100:00100000:1.0:1789136197.109597:0:24897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789136197.109604:0:24897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94a07f9dda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876044587235840:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789136197.109621:0:24897:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25562816 pending 0 free 3923509248 avail 3691958272 00000100:00100000:1.0:1789136197.109684:0:24897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94a07f9dda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876044587235840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (1382us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136197.109691:0:24897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789136197.109719:0:24897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789136197.109725:0:24897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff949f4401f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876044587235968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789136197.109736:0:24897:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25562816 pending 0 free 3923509248 avail 3691958272 00000100:00100000:1.0:1789136197.109762:0:24897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff949f4401f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876044587235968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 37us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136197.109781:0:24897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789136197.109820:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff949f4401c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876044587235968:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789136197.109835:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94a07f9dcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876044587235840:0@lo:13:osp-pre-1-1.0 Debug log: 14403 lines, 14403 kept, 0 dropped, 0 bad.