00010000:00010000:2.0F:1782107334.976165:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1782107335.272272:0:5829:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967340 is committed 00000100:00100000:1.0F:1782107335.744381:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe85bc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472455168:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782107335.744486:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0F:1782107335.744698:0:7540:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472455168 00000100:00100000:3.0:1782107335.744717:0:7540:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472455168 00000100:00100000:3.0:1782107335.744796:0:7540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1782107335.744816:0:7540:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec1033100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472455168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782107335.744868:0:7540:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1782107335.744936:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782107335.745857:0:7540:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec1033100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472455168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1048us (1366us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107335.745867:0:7540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1782107335.746155:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe85bc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472455168:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782107336.004300:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782107336.497402:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1782107336.497441:0:5808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447228672 00000100:00100000:1.0:1782107336.497451:0:5808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447228672 00000100:00100000:1.0:1782107336.497519:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 108 00000100:00100000:1.0:1782107336.497529:0:5808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec1032a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+5:25362:x1868674447228672:12345-192.168.202.26@tcp:101:rm.0 00010000:00010000:1.0:1782107336.497551:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782107336.497574:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec0d44e00/0xc2d453a189c7c2b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3a14c714ec608837 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107336.497654:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec0d45a00/0xc2d453a189c7c2bb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107336.497669:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec0d45a00/0xc2d453a189c7c2bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107336.497683:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec0d45a00/0xc2d453a189c7c2bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782107336.497922:0:5808:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1782107336.497927:0:5808:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1782107336.498047:0:5808:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abec0d45a00/0xc2d453a189c7c2bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107336.498072:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec0d44e00/0xc2d453a189c7c2b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608837 expref: 7 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107336.498090:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec0d45a00/0xc2d453a189c7c2bb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608837 expref: 6 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107336.498104:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abe84d6a100) 00010000:00010000:1.0:1782107336.498107:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782107336.498111:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec0d45a00, rc 0) 00000100:00100000:1.0:1782107336.498411:0:5808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec1032a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+6:25362:x1868674447228672:12345-192.168.202.26@tcp:101:rm.0 Request processed in 882us (1019us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107336.498418:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 108 00000100:00080000:1.0:1782107336.498445:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782107336.502595:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1782107336.504709:0:5807:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447228800 00000100:00100000:3.0:1782107336.504724:0:5807:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447228800 00000100:00100000:0.0F:1782107336.505246:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 109 00000100:00100000:0.0:1782107336.505268:0:5807:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe85bc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7809e99e-e82d-45c5-af74-069d8f4d001a+6:25362:x1868674447228800:12345-192.168.202.26@tcp:101:rm.0 00010000:00010000:0.0:1782107336.505292:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782107336.505317:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f800/0xc2d453a189c7c2c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3a14c714ec60883e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107336.505383:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ec00/0xc2d453a189c7c2c9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107336.505398:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ec00/0xc2d453a189c7c2c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107336.505410:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ec00/0xc2d453a189c7c2c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107336.505427:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f600/0xc2d453a189c7c2d0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf93a678a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107336.505434:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f600/0xc2d453a189c7c2d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf93a678a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107336.505442:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f600/0xc2d453a189c7c2d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf93a678a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107336.506740:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439e200/0xc2d453a189c7c2d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107336.506756:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439e200/0xc2d453a189c7c2d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107336.506765:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439e200/0xc2d453a189c7c2d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782107336.506806:0:5807:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0xd:0x0]: returning size 0 00000004:00200000:0.0:1782107336.506810:0:5807:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782107336.506953:0:5807:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439e200/0xc2d453a189c7c2d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107336.506965:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439e200/0xc2d453a189c7c2d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107336.507001:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ec00/0xc2d453a189c7c2c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107336.507008:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ec00/0xc2d453a189c7c2c9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107336.507016:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ec00/0xc2d453a189c7c2c9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107336.507031:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abe8439ec00 already unused, calling callback (ffffffffc1e4c4f0) 00010000:00010000:0.0:1782107336.507035:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ec00/0xc2d453a189c7c2c9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107336.507043:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ec00/0xc2d453a189c7c2c9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107336.507055:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abe84d6a100) 00010000:00010000:0.0:1782107336.507058:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782107336.507063:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ec00/0xc2d453a189c7c2c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107336.507068:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ec00/0xc2d453a189c7c2c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107336.507088:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f600/0xc2d453a189c7c2d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf93a678a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107336.507094:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f600/0xc2d453a189c7c2d0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf93a678a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107336.507099:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f600/0xc2d453a189c7c2d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf93a678a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107336.507103:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abe8439f600 already unused, calling callback (ffffffffc1e4c4f0) 00010000:00010000:0.0:1782107336.507105:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f600/0xc2d453a189c7c2d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf93a678a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107336.507111:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f600/0xc2d453a189c7c2d0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf93a678a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107336.507118:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf93a678a (ffff8abe89048d00) 00010000:00010000:0.0:1782107336.507121:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782107336.507123:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f600/0xc2d453a189c7c2d0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf93a678a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107336.507129:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f600/0xc2d453a189c7c2d0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf93a678a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107336.507230:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f800/0xc2d453a189c7c2c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec60883e expref: 8 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107336.507245:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439e200/0xc2d453a189c7c2d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec60883e expref: 7 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107336.507262:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8abe89048e00) 00010000:00010000:0.0:1782107336.507264:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782107336.507267:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abe8439e200, rc 0) 00000100:00100000:0.0:1782107336.507342:0:5807:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe85bc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7809e99e-e82d-45c5-af74-069d8f4d001a+7:25362:x1868674447228800:12345-192.168.202.26@tcp:101:rm.0 Request processed in 2076us (4756us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107336.507350:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 109 00000100:00100000:1.0:1782107336.522544:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1782107336.522930:0:5808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447229056 00000100:00100000:2.0:1782107336.522940:0:5808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447229056 00000100:00100000:2.0:1782107336.523030:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 110 00000100:00100000:2.0:1782107336.523041:0:5808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec0e2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+7:25362:x1868674447229056:12345-192.168.202.26@tcp:36:rm.0 00010000:00010000:2.0:1782107336.523095:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1782107336.523120:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439e200/0xc2d453a189c7c2d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec60883e expref: 7 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107336.523138:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8abe89048e00) 00010000:00010000:2.0:1782107336.523170:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec0d45a00/0xc2d453a189c7c2bb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608837 expref: 6 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107336.523182:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abe84d6a100) 00010000:00010000:2.0:1782107336.523189:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782107336.523211:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349a00/0xc2d453a189c7c2de lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107336.523224:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349a00/0xc2d453a189c7c2de lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107336.523233:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349a00/0xc2d453a189c7c2de lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107336.523245:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348e00/0xc2d453a189c7c2e5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf93a678a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107336.523252:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348e00/0xc2d453a189c7c2e5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf93a678a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107336.523267:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348e00/0xc2d453a189c7c2e5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf93a678a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107336.523588:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348000/0xc2d453a189c7c2ec lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107336.523597:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348000/0xc2d453a189c7c2ec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107336.523605:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348000/0xc2d453a189c7c2ec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107336.525333:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348800/0xc2d453a189c7c2f3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107336.525349:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348800/0xc2d453a189c7c2f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107336.525359:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348800/0xc2d453a189c7c2f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107336.525366:0:5808:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348800/0xc2d453a189c7c2f3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107336.525373:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348800/0xc2d453a189c7c2f3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107336.525379:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348800/0xc2d453a189c7c2f3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107336.525613:0:5808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782107336.525636:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348000/0xc2d453a189c7c2ec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107336.525650:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348000/0xc2d453a189c7c2ec lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107336.525656:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348000/0xc2d453a189c7c2ec lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107336.525661:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec1348000 already unused, calling callback (ffffffffc1e4c4f0) 00010000:00010000:2.0:1782107336.525665:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348000/0xc2d453a189c7c2ec lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107336.525673:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348000/0xc2d453a189c7c2ec lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107336.525684:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8abe898b2100) 00010000:00010000:2.0:1782107336.525686:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782107336.525690:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348000/0xc2d453a189c7c2ec lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107336.525696:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348000/0xc2d453a189c7c2ec lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107336.525711:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349a00/0xc2d453a189c7c2de lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107336.525717:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349a00/0xc2d453a189c7c2de lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107336.525722:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349a00/0xc2d453a189c7c2de lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107336.525726:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec1349a00 already unused, calling callback (ffffffffc1e4c4f0) 00010000:00010000:2.0:1782107336.525733:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349a00/0xc2d453a189c7c2de lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107336.525738:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349a00/0xc2d453a189c7c2de lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107336.525744:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abe898b2200) 00010000:00010000:2.0:1782107336.525746:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782107336.525749:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349a00/0xc2d453a189c7c2de lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107336.525754:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349a00/0xc2d453a189c7c2de lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782107336.525765:0:5808:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000a25be029 reply state 000000003f9eb29f transno 4294967341 ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348e00/0xc2d453a189c7c2e5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf93a678a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782107336.525772:0:5808:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782107336.525940:0:5808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec0e2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+7:25362:x1868674447229056:12345-192.168.202.26@tcp:36:rm.0 Request processed in 2897us (3400us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1782107336.525950:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 110 00010000:00010000:1.0:1782107336.533837:0:8257:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782107336.533851:0:8257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348800/0xc2d453a189c7c2f3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107336.533864:0:8257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec1348800 already unused, calling callback (ffffffffc13e26f0) 00010000:00010000:1.0:1782107336.533868:0:8257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348800/0xc2d453a189c7c2f3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107336.533877:0:8257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348800/0xc2d453a189c7c2f3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107336.533895:0:8257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8abe898b2100) 00010000:00010000:1.0:1782107336.533899:0:8257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1782107336.533903:0:8257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348800/0xc2d453a189c7c2f3 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107336.533909:0:8257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348800/0xc2d453a189c7c2f3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107336.533937:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782107336.533939:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782107336.533950:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782107336.534700:0:3310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348e00/0xc2d453a189c7c2e5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf93a678a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107336.534711:0:3310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348e00/0xc2d453a189c7c2e5 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf93a678a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107336.534717:0:3310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348e00/0xc2d453a189c7c2e5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf93a678a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107336.534722:0:3310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec1348e00 already unused, calling callback (ffffffffc1e4c4f0) 00010000:00010000:2.0:1782107336.534725:0:3310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348e00/0xc2d453a189c7c2e5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf93a678a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107336.534738:0:3310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348e00/0xc2d453a189c7c2e5 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf93a678a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107336.534748:0:3310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf93a678a (ffff8abe898b2400) 00010000:00010000:2.0:1782107336.534751:0:3310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782107336.534754:0:3310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348e00/0xc2d453a189c7c2e5 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf93a678a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107336.534759:0:3310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348e00/0xc2d453a189c7c2e5 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf93a678a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782107336.769514:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe85bc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472455296:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782107336.769591:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107336.769906:0:6580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472455296 00000100:00100000:2.0:1782107336.769915:0:6580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472455296 00000100:00100000:2.0:1782107336.770010:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1782107336.770030:0:6580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec1109880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472455296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782107336.770068:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782107336.770117:0:6580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec1109880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472455296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107336.770124:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00010000:00080000:2.0:1782107336.770176:0:3327:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abe85bc5f80 x1868674472455296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782107352 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782107336.770194:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe85bc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472455296:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782107336.770466:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782107337.009303:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1782107337.010143:0:5801:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447229184 00000100:00100000:2.0:1782107337.010157:0:5801:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447229184 00000100:00100000:2.0:1782107337.010509:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 339 00000100:00100000:2.0:1782107337.010523:0:5801:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe86809c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88852592-b9c0-40cb-a875-489a88776a1c+9:2370:x1868674447229184:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:2.0:1782107337.010645:0:5801:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe86809c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88852592-b9c0-40cb-a875-489a88776a1c+9:2370:x1868674447229184:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 124us (1349us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107337.010653:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 339 00010000:00010000:2.0:1782107337.024416:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782107338.053291:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782107338.817870:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abeafffdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472455808:0@lo:400:kworker.0 00000100:00100000:3.0:1782107338.817943:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107338.818032:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782107338.818039:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abeafffc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3327:1868674472455680:0@lo:400:kworker.0 00000100:00100000:3.0:1782107338.818066:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107338.821236:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe8439a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3324:1868674472455424:0@lo:400:kworker.0 00000100:00100000:1.0:1782107338.821307:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107338.821356:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abeafffd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1868674472455936:0@lo:400:kworker.0 00000100:00100000:1.0:1782107338.821384:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107338.821414:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1782107338.821422:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe84398000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3324:1868674472455552:0@lo:400:kworker.0 00000100:00100000:1.0:1782107338.821443:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107338.821461:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abeaffaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1868674472456064:0@lo:400:kworker.0 00000100:00100000:1.0:1782107338.821486:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107338.821520:0:6576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472455808 00000100:00100000:1.0:1782107338.821527:0:6576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472455808 00000100:00100000:1.0:1782107338.821575:0:6576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472456064 00000100:00100000:1.0:1782107338.821579:0:6576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472456064 00000100:00100000:1.0:1782107338.821601:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1782107338.821610:0:6576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec1317b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472455808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107338.821668:0:6576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec1317b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472455808:12345-0@lo:400:kworker.0 Request processed in 59us (3725us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107338.821676:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1782107338.821692:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1782107338.821698:0:6576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe991d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3324:x1868674472456064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107338.821729:0:6576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe991d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3324:x1868674472456064:12345-0@lo:400:kworker.0 Request processed in 30us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107338.821735:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1782107338.821766:0:5809:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472455680 00000100:00100000:1.0:1782107338.821779:0:5809:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472455680 00000100:00100000:1.0:1782107338.821806:0:5809:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472455936 00000100:00100000:1.0:1782107338.821808:0:5809:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472455936 00000100:00100000:1.0:1782107338.821820:0:5809:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472455552 00000100:00100000:1.0:1782107338.821822:0:5809:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472455552 00000100:00100000:1.0:1782107338.821836:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1782107338.821842:0:5809:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec1314a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1868674472455680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107338.821873:0:5809:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec1314a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1868674472455680:12345-0@lo:400:kworker.0 Request processed in 31us (3806us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107338.821879:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1782107338.821891:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1782107338.821897:0:5809:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec0e2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1868674472455936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107338.821922:0:5809:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec0e2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1868674472455936:12345-0@lo:400:kworker.0 Request processed in 26us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107338.821927:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1782107338.821937:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1782107338.821942:0:5809:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec130bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1868674472455552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107338.821965:0:5809:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec130bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1868674472455552:12345-0@lo:400:kworker.0 Request processed in 23us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107338.821990:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1782107338.822020:0:5799:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472455424 00000100:00100000:1.0:1782107338.822024:0:5799:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472455424 00000100:00100000:1.0:1782107338.822048:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1782107338.822055:0:5799:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe86808c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3324:x1868674472455424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107338.822083:0:5799:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe86808c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3324:x1868674472455424:12345-0@lo:400:kworker.0 Request processed in 29us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107338.822089:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00080000:1.0:1782107338.822133:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782107338.822138:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782107338.822139:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782107338.822182:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abeafffc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3327:1868674472455680:0@lo:400:kworker.0 00010000:00080000:1.0:1782107338.822198:0:3327:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abeafffdf80 x1868674472455808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782107354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782107338.822209:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abeafffdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472455808:0@lo:400:kworker.0 00000100:00100000:1.0:1782107338.822242:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe84398000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3324:1868674472455552:0@lo:400:kworker.0 00000100:00100000:1.0:1782107338.822251:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abeaffaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1868674472456064:0@lo:400:kworker.0 00000100:00100000:1.0:1782107338.822258:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe8439a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3324:1868674472455424:0@lo:400:kworker.0 00000100:00100000:1.0:1782107338.822267:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abeafffd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1868674472455936:0@lo:400:kworker.0 00010000:00010000:1.0:1782107339.072289:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782107340.106696:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1782107340.466304:0:5829:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967341 is committed 00000100:00100000:0.0:1782107340.864828:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782107340.864852:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe85bc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472456192:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782107340.864934:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107340.865253:0:7540:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472456192 00000100:00100000:2.0:1782107340.865263:0:7540:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472456192 00000100:00100000:2.0:1782107340.865338:0:7540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1782107340.865349:0:7540:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe990fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472456192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782107340.865394:0:7540:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782107340.865444:0:7540:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe990fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472456192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107340.865450:0:7540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00080000:1.0:1782107340.865514:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782107340.865657:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe85bc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472456192:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782107341.120172:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782107341.890652:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe990fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472456320:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782107341.890729:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107341.890809:0:6579:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472456320 00000100:00100000:0.0:1782107341.890818:0:6579:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472456320 00000100:00100000:0.0:1782107341.890873:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1782107341.890883:0:6579:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe990f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472456320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782107341.890923:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782107341.894885:0:6579:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe990f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472456320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3995us (4147us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107341.894899:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:0.0:1782107341.896306:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1782107341.897505:0:3327:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abe990fb800 x1868674472456320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782107357 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782107341.897542:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe990fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472456320:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782107342.135448:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1782107342.135494:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1782107342.135525:0:5801:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447229312 00000100:00100000:1.0:1782107342.135534:0:5801:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447229312 00000100:00100000:1.0:1782107342.135592:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 341 00000100:00100000:1.0:1782107342.135602:0:5801:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe8680ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88852592-b9c0-40cb-a875-489a88776a1c+9:2371:x1868674447229312:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1782107342.135671:0:5801:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe8680ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88852592-b9c0-40cb-a875-489a88776a1c+9:2371:x1868674447229312:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 71us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107342.135679:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 341 00000100:00100000:3.0:1782107342.136131:0:5809:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447229440 00000100:00100000:3.0:1782107342.136137:0:5809:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447229440 00000100:00100000:3.0:1782107342.137526:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 306 00000100:00100000:3.0:1782107342.137543:0:5809:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abeaffaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2371:x1868674447229440:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1782107342.138422:0:5809:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abeaffaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2371:x1868674447229440:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 880us (2978us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107342.138433:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 306 00000100:00080000:3.0:1782107342.138469:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782107342.145298:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782107343.168284:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782107343.936451:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe85bc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3324:1868674472456448:0@lo:400:kworker.0 00000100:00100000:0.0:1782107343.936451:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe85a6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1868674472456704:0@lo:400:kworker.0 00000100:00100000:1.0:1782107343.937084:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107343.937177:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abeb420a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1868674472456960:0@lo:400:kworker.0 00000100:00100000:3.0:1782107343.937493:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abeb420bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472456832:0@lo:400:kworker.0 00000100:00100000:0.0:1782107343.937774:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107343.937836:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe85bc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1868674472456576:0@lo:400:kworker.0 00000100:00100000:0.0:1782107343.937859:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107343.937874:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abeb420a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1868674472457088:0@lo:400:kworker.0 00000100:00100000:0.0:1782107343.937895:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107343.937929:0:5808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472456704 00000100:00100000:0.0:1782107343.937936:0:5808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472456704 00000100:00100000:0.0:1782107343.938029:0:5808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472456576 00000100:00100000:0.0:1782107343.938032:0:5808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472456576 00000100:00100000:0.0:1782107343.938052:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1782107343.938060:0:5808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe990faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1868674472456704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782107343.938110:0:5808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe990faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1868674472456704:12345-0@lo:400:kworker.0 Request processed in 50us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107343.938117:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1782107343.938134:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1782107343.938139:0:5808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe990f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1868674472456576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782107343.938166:0:5808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe990f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1868674472456576:12345-0@lo:400:kworker.0 Request processed in 27us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107343.938171:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00080000:0.0:1782107343.938187:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782107343.938313:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe85bc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1868674472456576:0@lo:400:kworker.0 00000100:00100000:0.0:1782107343.938344:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe85a6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1868674472456704:0@lo:400:kworker.0 00000100:00100000:0.0:1782107343.938370:0:6576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472457088 00000100:00100000:0.0:1782107343.938373:0:6576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472457088 00000100:00100000:0.0:1782107343.938420:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1782107343.938426:0:6576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe990f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3325:x1868674472457088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782107343.938460:0:6576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe990f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3325:x1868674472457088:12345-0@lo:400:kworker.0 Request processed in 34us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107343.938466:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00080000:0.0:1782107343.938479:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782107343.938494:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abeb420a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1868674472457088:0@lo:400:kworker.0 00000100:00100000:2.0:1782107343.938827:0:5802:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472456448 00000100:00100000:2.0:1782107343.938833:0:5802:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472456448 00000100:00100000:2.0:1782107343.938865:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1782107343.938873:0:5802:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe8680a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3324:x1868674472456448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782107343.938915:0:5802:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe8680a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3324:x1868674472456448:12345-0@lo:400:kworker.0 Request processed in 44us (1832us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107343.938921:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1782107343.939344:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107343.939419:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe85bc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3324:1868674472456448:0@lo:400:kworker.0 00000100:00100000:2.0:1782107343.939470:0:5808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472456960 00000100:00100000:2.0:1782107343.939482:0:5808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472456960 00000100:00100000:2.0:1782107343.939563:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1782107343.939570:0:5808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe8439a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1868674472456960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782107343.939612:0:5808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe8439a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1868674472456960:12345-0@lo:400:kworker.0 Request processed in 43us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107343.939619:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00080000:1.0:1782107343.939659:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782107343.939683:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abeb420a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1868674472456960:0@lo:400:kworker.0 00000100:00100000:3.0:1782107343.942503:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107343.944343:0:8608:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472456832 00000100:00100000:1.0:1782107343.944361:0:8608:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472456832 00000100:00100000:1.0:1782107343.944447:0:8608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1782107343.944458:0:8608:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec215f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472456832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107343.944536:0:8608:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec215f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472456832:12345-0@lo:400:kworker.0 Request processed in 79us (2041us total) trans 0 rc 0/0 00000100:00080000:0.0:1782107343.944622:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782107343.944653:0:8608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00010000:00080000:3.0:1782107343.944751:0:3327:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abeb420bb80 x1868674472456832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782107359 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782107343.944784:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abeb420bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472456832:0@lo:400:kworker.0 00010000:00010000:2.0:1782107344.195934:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782107344.950243:0:20921:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 6b: EC write selects data mirror, not parity mirror ========================================================== 01:49:04 (1782107344) 00010000:00010000:1.0:1782107345.217393:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782107345.253626:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1782107345.254028:0:5809:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447229568 00000100:00100000:0.0:1782107345.254043:0:5809:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447229568 00000100:00100000:0.0:1782107345.254127:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 111 00000100:00100000:0.0:1782107345.254139:0:5809:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe84398000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7809e99e-e82d-45c5-af74-069d8f4d001a+5:25647:x1868674447229568:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:0.0:1782107345.254173:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782107345.254197:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439e600/0xc2d453a189c7c2fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3a14c714ec608845 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107345.254280:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ee00/0xc2d453a189c7c301 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107345.254295:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ee00/0xc2d453a189c7c301 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107345.254663:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ee00/0xc2d453a189c7c301 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1782107345.255274:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:2.0:1782107345.260034:0:5809:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1782107345.260044:0:5809:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1782107345.261997:0:5809:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ee00/0xc2d453a189c7c301 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.262056:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439e600/0xc2d453a189c7c2fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608845 expref: 7 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.262077:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ee00/0xc2d453a189c7c301 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608845 expref: 6 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.262087:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abe89048d00) 00010000:00010000:2.0:1782107345.262090:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782107345.262093:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abe8439ee00, rc 0) 00000100:00100000:2.0:1782107345.263484:0:5809:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe84398000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7809e99e-e82d-45c5-af74-069d8f4d001a+6:25647:x1868674447229568:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 9338us (9859us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107345.264557:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 111 00000100:00100000:1.0:1782107345.272244:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1782107345.273243:0:5808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447229696 00000100:00100000:2.0:1782107345.273267:0:5808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447229696 00000100:00100000:2.0:1782107345.273340:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 112 00000100:00100000:2.0:1782107345.273351:0:5808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abeafffd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+6:25647:x1868674447229696:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:2.0:1782107345.273398:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782107345.273421:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348600/0xc2d453a189c7c308 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3a14c714ec60884c expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.273486:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349600/0xc2d453a189c7c30f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.273857:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349600/0xc2d453a189c7c30f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.273872:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349600/0xc2d453a189c7c30f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.273931:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348400/0xc2d453a189c7c316 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64d10ce5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.273940:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348400/0xc2d453a189c7c316 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64d10ce5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.273958:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348400/0xc2d453a189c7c316 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64d10ce5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.274494:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349600/0xc2d453a189c7c30f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.274512:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349600/0xc2d453a189c7c30f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.274519:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349600/0xc2d453a189c7c30f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.274525:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec1349600 already unused, calling callback (ffffffffc1e4c4f0) 00010000:00010000:2.0:1782107345.274685:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349600/0xc2d453a189c7c30f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.274814:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349600/0xc2d453a189c7c30f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.274832:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abe89048d00) 00010000:00010000:2.0:1782107345.274835:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782107345.274841:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349600/0xc2d453a189c7c30f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.274848:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349600/0xc2d453a189c7c30f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.274862:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348400/0xc2d453a189c7c316 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64d10ce5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.274868:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348400/0xc2d453a189c7c316 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64d10ce5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.274875:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348400/0xc2d453a189c7c316 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64d10ce5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.274880:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec1348400 already unused, calling callback (ffffffffc1e4c4f0) 00010000:00010000:2.0:1782107345.274883:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348400/0xc2d453a189c7c316 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64d10ce5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.274889:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348400/0xc2d453a189c7c316 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64d10ce5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.274897:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x64d10ce5 (ffff8abe898b2200) 00010000:00010000:2.0:1782107345.274899:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782107345.274909:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348400/0xc2d453a189c7c316 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64d10ce5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.274915:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348400/0xc2d453a189c7c316 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64d10ce5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.274969:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348600/0xc2d453a189c7c308 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec60884c expref: 7 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.275024:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abe89048d00) 00010000:00010000:2.0:1782107345.275027:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782107345.275032:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348600/0xc2d453a189c7c308 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec60884c expref: 7 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.275041:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec1348600, rc 0) 00000100:00100000:2.0:1782107345.275122:0:5808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abeafffd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+6:25647:x1868674447229696:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 1771us (2887us total) trans 0 rc 301/301 00000100:00100000:2.0:1782107345.275131:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 112 00000100:00100000:3.0:1782107345.283574:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1782107345.284063:0:5807:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447229952 00000100:00100000:2.0:1782107345.284077:0:5807:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447229952 00000100:00100000:2.0:1782107345.284154:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 113 00000100:00100000:2.0:1782107345.284169:0:5807:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec215df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7809e99e-e82d-45c5-af74-069d8f4d001a+6:25647:x1868674447229952:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:2.0:1782107345.284193:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782107345.284196:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1782107345.284222:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ee00/0xc2d453a189c7c301 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608845 expref: 6 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.284241:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abe89048d00) 00010000:00010000:2.0:1782107345.284264:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782107345.285594:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348600/0xc2d453a189c7c31d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3a14c714ec608853 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.286089:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348400/0xc2d453a189c7c324 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.286106:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348400/0xc2d453a189c7c324 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.286117:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348400/0xc2d453a189c7c324 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.286133:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349600/0xc2d453a189c7c32b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x64d10ce5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.286139:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349600/0xc2d453a189c7c32b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x64d10ce5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.286153:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349600/0xc2d453a189c7c32b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x64d10ce5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.290539:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348200/0xc2d453a189c7c332 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.290559:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348200/0xc2d453a189c7c332 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.290572:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348200/0xc2d453a189c7c332 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782107345.290584:0:5807:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1782107345.290611:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348400/0xc2d453a189c7c324 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.290629:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348400/0xc2d453a189c7c324 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.290636:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348400/0xc2d453a189c7c324 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.290642:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec1348400 already unused, calling callback (ffffffffc1e4c4f0) 00010000:00010000:2.0:1782107345.290646:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348400/0xc2d453a189c7c324 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.290654:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348400/0xc2d453a189c7c324 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.290666:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abe898b2200) 00010000:00010000:2.0:1782107345.290669:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782107345.290674:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348400/0xc2d453a189c7c324 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.290680:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348400/0xc2d453a189c7c324 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782107345.290694:0:5807:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000005ee3c8c2 reply state 0000000007d25095 transno 4294967342 ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349600/0xc2d453a189c7c32b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x64d10ce5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782107345.290704:0:5807:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782107345.296475:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348600/0xc2d453a189c7c31d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608853 expref: 8 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.296514:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348200/0xc2d453a189c7c332 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608853 expref: 7 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.296550:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8abe898b2500) 00010000:00010000:2.0:1782107345.296553:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782107345.296557:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec1348200, rc 0) 00000100:00100000:2.0:1782107345.296639:0:5807:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec215df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7809e99e-e82d-45c5-af74-069d8f4d001a+8:25647:x1868674447229952:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 12474us (13078us total) trans 4294967342 rc 0/0 00000100:00100000:2.0:1782107345.296648:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 113 00010000:00010000:0.0:1782107345.315770:0:3311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349600/0xc2d453a189c7c32b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x64d10ce5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107345.315789:0:3311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349600/0xc2d453a189c7c32b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x64d10ce5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107345.315811:0:3311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349600/0xc2d453a189c7c32b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x64d10ce5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107345.315817:0:3311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec1349600 already unused, calling callback (ffffffffc1e4c4f0) 00010000:00010000:0.0:1782107345.315822:0:3311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349600/0xc2d453a189c7c32b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x64d10ce5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107345.315830:0:3311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349600/0xc2d453a189c7c32b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x64d10ce5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107345.315848:0:3311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x64d10ce5 (ffff8abe898b2900) 00010000:00010000:0.0:1782107345.315851:0:3311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782107345.315856:0:3311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349600/0xc2d453a189c7c32b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x64d10ce5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107345.315862:0:3311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349600/0xc2d453a189c7c32b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x64d10ce5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782107345.322555:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1782107345.324020:0:7463:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447230208 00000100:00100000:0.0:1782107345.324037:0:7463:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447230208 00000100:00100000:0.0:1782107345.324112:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 114 00000100:00100000:0.0:1782107345.324125:0:7463:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec215c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7809e99e-e82d-45c5-af74-069d8f4d001a+7:25647:x1868674447230208:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:0.0:1782107345.324163:0:7463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782107345.324187:0:7463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f200/0xc2d453a189c7c340 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3a14c714ec60885a expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107345.324288:0:7463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f400/0xc2d453a189c7c347 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107345.324538:0:7463:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348200/0xc2d453a189c7c332 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608853 expref: 8 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107345.324548:0:7463:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f400/0xc2d453a189c7c347 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107345.324850:0:7463:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348200/0xc2d453a189c7c332 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608853 expref: 8 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107345.324866:0:7463:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348200/0xc2d453a189c7c332 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608853 expref: 8 pid: 5807 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782107345.324880:0:7463:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abec215ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7463:1868674472457216:192.168.202.26@tcp:104: 00000100:00100000:3.0:1782107345.325027:0:7463:0:(client.c:2692:ptlrpc_set_wait()) set ffff8abe92ae0480 going to sleep for 11 seconds 00000100:00100000:2.0:1782107345.336178:0:7463:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abec215ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7463:1868674472457216:192.168.202.26@tcp:104: 00010000:00010000:2.0:1782107345.336211:0:7463:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f400/0xc2d453a189c7c347 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782107345.336858:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1782107345.337015:0:5794:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447230336 00000100:00100000:0.0:1782107345.337023:0:5794:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447230336 00010000:00010000:0.0:1782107345.337061:0:5794:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348200/0xc2d453a189c7c332 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608853 expref: 9 pid: 5807 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782107345.337099:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 40 00000100:00100000:0.0:1782107345.337108:0:5794:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec215c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7809e99e-e82d-45c5-af74-069d8f4d001a+9:2370:x1868674447230336:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782107345.337124:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782107345.337130:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348200/0xc2d453a189c7c332 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608853 expref: 9 pid: 5807 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107345.337142:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348200/0xc2d453a189c7c332 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608853 expref: 9 pid: 5807 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107345.337175:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348200/0xc2d453a189c7c332 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608853 expref: 9 pid: 5807 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107345.337191:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8abe898b2500) 00010000:00010000:0.0:1782107345.337197:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f400/0xc2d453a189c7c347 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107345.337228:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f400/0xc2d453a189c7c347 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107345.337235:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f400/0xc2d453a189c7c347 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107345.337265:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782107345.337330:0:5794:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec215c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7809e99e-e82d-45c5-af74-069d8f4d001a+8:2370:x1868674447230336:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 222us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107345.337338:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 40 00010000:00010000:2.0:1782107345.337471:0:7463:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f400/0xc2d453a189c7c347 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.337479:0:7463:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f400/0xc2d453a189c7c347 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782107345.337515:0:7463:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1782107345.337783:0:7463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f400/0xc2d453a189c7c347 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.337793:0:7463:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f400/0xc2d453a189c7c347 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.337799:0:7463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f400/0xc2d453a189c7c347 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.337805:0:7463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abe8439f400 already unused, calling callback (ffffffffc1e4c4f0) 00010000:00010000:2.0:1782107345.337809:0:7463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f400/0xc2d453a189c7c347 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.337824:0:7463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f400/0xc2d453a189c7c347 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.337834:0:7463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8abe898b2500) 00010000:00010000:2.0:1782107345.337837:0:7463:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782107345.337841:0:7463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f400/0xc2d453a189c7c347 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.337846:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f400/0xc2d453a189c7c347 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.337886:0:7463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f200/0xc2d453a189c7c340 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec60885a expref: 7 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.337894:0:7463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abe89048300) 00010000:00010000:2.0:1782107345.337896:0:7463:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782107345.337899:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f200/0xc2d453a189c7c340 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec60885a expref: 7 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.337911:0:7463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abe8439f200, rc 0) 00000100:00100000:2.0:1782107345.337953:0:7463:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec215c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7809e99e-e82d-45c5-af74-069d8f4d001a+6:25647:x1868674447230208:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 13821us (15409us total) trans 0 rc 301/301 00000100:00100000:2.0:1782107345.337961:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 114 00000100:00100000:3.0:1782107345.355491:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1782107345.355599:0:5811:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447230592 00000100:00100000:0.0:1782107345.355611:0:5811:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447230592 00000100:00100000:0.0:1782107345.355676:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 17 00000100:00100000:0.0:1782107345.355687:0:5811:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec215f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+6:25647:x1868674447230592:12345-192.168.202.26@tcp:35:lfs.0 00000100:00100000:0.0:1782107345.355938:0:5811:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec215f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+7:25647:x1868674447230592:12345-192.168.202.26@tcp:35:lfs.0 Request processed in 252us (453us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1782107345.355957:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 17 00000001:00080000:3.0:1782107345.552333:0:5829:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967343 is committed 00000100:00100000:0.0:1782107345.985075:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abeb420ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472457344:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782107345.985157:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107345.985554:0:6580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472457344 00000100:00100000:2.0:1782107345.985562:0:6580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472457344 00000100:00100000:2.0:1782107345.985634:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1782107345.985645:0:6580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe990f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472457344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782107345.985684:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782107345.985763:0:6580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe990f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472457344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107345.985771:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:1.0:1782107345.985883:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782107345.985905:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abeb420ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472457344:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782107346.240289:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782107346.996474:0:20970:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-ec test_6b: @@@@@@ FAIL: create EC file failed 00000100:00100000:3.0:1782107347.009881:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abeb4208000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472457472:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782107347.010036:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107347.010185:0:7540:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472457472 00000100:00100000:3.0:1782107347.010193:0:7540:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472457472 00000100:00100000:3.0:1782107347.010494:0:7540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1782107347.010504:0:7540:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec215ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472457472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782107347.010554:0:7540:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782107347.010604:0:7540:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec215ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472457472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107347.010620:0:7540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00010000:00080000:3.0:1782107347.010664:0:3327:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abeb4208000 x1868674472457472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782107363 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782107347.010684:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abeb4208000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472457472:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782107347.010952:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782107347.254224:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1782107347.254955:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1782107347.255021:0:5799:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447230720 00000100:00100000:0.0:1782107347.255031:0:5799:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447230720 00000100:00100000:0.0:1782107347.255082:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 343 00000100:00100000:0.0:1782107347.255093:0:5799:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe8680b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88852592-b9c0-40cb-a875-489a88776a1c+9:2370:x1868674447230720:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1782107347.255182:0:5799:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe8680b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88852592-b9c0-40cb-a875-489a88776a1c+9:2370:x1868674447230720:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 90us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107347.255189:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 343 00000100:00100000:3.0:1782107347.270507:0:5809:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447230848 00000100:00100000:3.0:1782107347.270524:0:5809:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447230848 00000100:00100000:3.0:1782107347.270604:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 310 00000100:00100000:3.0:1782107347.270616:0:5809:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe990f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2370:x1868674447230848:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1782107347.270701:0:5809:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe990f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2370:x1868674447230848:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 87us (16487us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107347.270708:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 310 00000100:00080000:3.0:1782107347.270745:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782107347.271904:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782107348.288183:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 557 lines, 557 kept, 0 dropped, 0 bad.