00000100:00100000:2.0F:1787096558.286555:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0F:1787096558.286576:0:6469:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787096558.286582:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d7fa99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1873906360256896:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787096558.286599:0:3625:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42cb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1873906360257024:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787096558.286646:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096558.286662:0:8363:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360257024 00000100:00100000:2.0:1787096558.286670:0:8363:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360257024 00000100:00100000:2.0:1787096558.286725:0:8363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787096558.286736:0:8363:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7fa9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1873906360257024:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787096558.286738:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1787096558.286767:0:8363:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787096558.286824:0:8363:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7fa9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1873906360257024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096558.286833:0:8363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787096558.286859:0:3625:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42cb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1873906360257024:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787096558.286867:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0F:1787096558.286918:0:19615:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360256896 00000100:00100000:0.0:1787096558.286927:0:19615:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360256896 00000100:00080000:1.0:1787096558.286965:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787096558.286965:0:19615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787096558.286975:0:19615:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42cb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1873906360256896:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787096558.286985:0:19615:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787096558.287019:0:19615:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42cb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1873906360256896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 47us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096558.287023:0:19615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787096558.287071:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d7fa99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1873906360256896:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1787096558.288282:0:7392:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4ae00/0x1b9fb40e15b43ef4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9280d55e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x1b9fb40e15b43efb expref: -99 pid: 7414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787096558.288297:0:7392:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4ae00/0x1b9fb40e15b43ef4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9280d55e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x1b9fb40e15b43efb expref: -99 pid: 7414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.288306:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2e00/0x1b9fb40e15b43bf9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.288314:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2e00/0x1b9fb40e15b43bf9 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.288319:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2e00/0x1b9fb40e15b43bf9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.288323:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d6eac2e00 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:0.0:1787096558.288326:0:7392:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4ae00/0x1b9fb40e15b43ef4 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9280d55e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1b9fb40e15b43efb expref: -99 pid: 7414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.288327:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2e00/0x1b9fb40e15b43bf9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096558.288343:0:7392:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787096558.288345:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2e00/0x1b9fb40e15b43bf9 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.288356:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff9c9d6b3f0700) 00010000:00010000:1.0:1787096558.288358:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096558.288360:0:7392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4ae00/0x1b9fb40e15b43ef4 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9280d55e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1b9fb40e15b43efb expref: -99 pid: 7414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.288362:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2e00/0x1b9fb40e15b43bf9 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.288376:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2e00/0x1b9fb40e15b43bf9 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096558.288387:0:7392:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac2600/0x1b9fb40e15b43d42 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x1b9fb40e15b43d49 expref: -99 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.288412:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2a00/0x1b9fb40e15b43c00 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096558.288416:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42d09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1873906360257152:0@lo:103:jbd2/dm-1-8.0 00000004:00010000:0.0:1787096558.288437:0:7392:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac2600/0x1b9fb40e15b43d42 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x1b9fb40e15b43d49 expref: -99 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.288439:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2a00/0x1b9fb40e15b43c00 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096558.288458:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787096558.288459:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2a00/0x1b9fb40e15b43c00 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.288466:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d6eac2a00 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:0.0:1787096558.288469:0:7392:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac2600/0x1b9fb40e15b43d42 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1b9fb40e15b43d49 expref: -99 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.288470:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2a00/0x1b9fb40e15b43c00 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.288487:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2a00/0x1b9fb40e15b43c00 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096558.288503:0:8378:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360257152 00010000:00010000:0.0:1787096558.288504:0:7392:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787096558.288510:0:8378:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360257152 00010000:00010000:1.0:1787096558.288510:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x2:0x0].0x0 (ffff9c9d6b3f0800) 00010000:00010000:1.0:1787096558.288515:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096558.288520:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2a00/0x1b9fb40e15b43c00 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096558.288523:0:7392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac2600/0x1b9fb40e15b43d42 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1b9fb40e15b43d49 expref: -99 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.288525:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2a00/0x1b9fb40e15b43c00 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096558.288554:0:8378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000001:00080000:0.0:1787096558.288556:0:7392:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967319 is committed 00010000:00010000:1.0:1787096558.288561:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cec00/0x1b9fb40e15b43c9a lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x2:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096558.288565:0:8378:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42cb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+8:3626:x1873906360257152:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1787096558.288570:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cec00/0x1b9fb40e15b43c9a lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x2:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787096558.288571:0:7392:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9c9d511a1540 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1787096558.288578:0:7392:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9c9c42b1ba00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9c9d511a1840 00010000:00010000:1.0:1787096558.288580:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cec00/0x1b9fb40e15b43c9a lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x2:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787096558.288583:0:7392:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].5 00010000:00010000:2.0:1787096558.288588:0:8378:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00080000:0.0:1787096558.288589:0:7392:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9c9c42b1b500 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c9c42b9e000 00010000:00010000:1.0:1787096558.288592:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d6e9cec00 already unused, calling callback (ffffffffc19474f0) 00000020:00080000:0.0:1787096558.288595:0:7392:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].5 00010000:00010000:1.0:1787096558.288603:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cec00/0x1b9fb40e15b43c9a lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x2:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787096558.288606:0:7392:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9c9d60b35180 refcount 2 committed 0 result 0 batchid 4 00010000:00010000:2.0:1787096558.288610:0:8378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3600/0x1b9fb40e15b43efb lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9280d55e bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x1b9fb40e15b43ef4 expref: 8 pid: 7409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787096558.288612:0:7392:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9c9d480b4d00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9c9c42a4ad80 00010000:00010000:1.0:1787096558.288615:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cec00/0x1b9fb40e15b43c9a lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x2:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6480 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787096558.288620:0:7392:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].4 00000020:00080000:0.0:1787096558.288624:0:7392:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9c9d480b4700 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c9c42eae000 00000020:00080000:0.0:1787096558.288630:0:7392:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].4 00010000:00010000:1.0:1787096558.288637:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x2:0x0].0x7b711ae6 (ffff9c9d48c61800) 00010000:00010000:1.0:1787096558.288640:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096558.288643:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cec00/0x1b9fb40e15b43c9a lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x2:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096558.288648:0:8378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9280d55e (ffff9c9d6b3f0a00) 00010000:00010000:1.0:1787096558.288648:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cec00/0x1b9fb40e15b43c9a lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x2:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787096558.288651:0:7392:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9c9d7bf5ea80 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1787096558.288657:0:7392:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9c9d480b4f00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9c9d7bf5e540 00000020:00080000:0.0:1787096558.288660:0:7392:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].3 00000020:00080000:0.0:1787096558.288662:0:7392:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9c9d480b4600 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c9c42b33200 00000020:00080000:0.0:1787096558.288664:0:7392:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].3 00010000:00010000:2.0:1787096558.288665:0:8378:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787096558.288669:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4b000/0x1b9fb40e15b43d1f lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x2:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6481 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787096558.288670:0:7392:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9c9c41c79cc0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1787096558.288675:0:7392:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9c9d47289100 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9c9c41c79e40 00000020:00080000:0.0:1787096558.288680:0:7392:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].2 00010000:00010000:1.0:1787096558.288681:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4b000/0x1b9fb40e15b43d1f lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x2:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6481 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787096558.288682:0:7392:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9c9d47289b00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c9d7bf73600 00010000:00010000:1.0:1787096558.288686:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4b000/0x1b9fb40e15b43d1f lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x2:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6481 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787096558.288695:0:7392:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].2 00010000:00010000:1.0:1787096558.288696:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d7ca4b000 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:1.0:1787096558.288701:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4b000/0x1b9fb40e15b43d1f lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x2:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6481 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096558.288702:0:8378:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42cb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+7:3626:x1873906360257152:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 140us (246us total) trans 0 rc 0/0 00010000:00010000:1.0:1787096558.288712:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4b000/0x1b9fb40e15b43d1f lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x2:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6481 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096558.288718:0:8378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000020:00080000:0.0:1787096558.288720:0:7392:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9c9c42a4a180 refcount 2 committed 0 result 0 batchid 1 00010000:00010000:1.0:1787096558.288721:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x2:0x0].0x7b711ae6 (ffff9c9d48c61800) 00010000:00010000:1.0:1787096558.288727:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000020:00080000:0.0:1787096558.288727:0:7392:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9c9d480b4100 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9c9c42a4ac00 00000020:00080000:0.0:1787096558.288732:0:7392:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].1 00010000:00010000:1.0:1787096558.288737:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4b000/0x1b9fb40e15b43d1f lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x2:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6481 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787096558.288737:0:7392:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9c9d480b4000 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c9d6e9f7600 00000020:00080000:0.0:1787096558.288742:0:7392:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].1 00010000:00010000:1.0:1787096558.288748:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4b000/0x1b9fb40e15b43d1f lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x2:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6481 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.288762:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cf200/0x1b9fb40e15b43db9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096558.288763:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787096558.288766:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42d09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1873906360257152:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1787096558.288773:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cf200/0x1b9fb40e15b43db9 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096558.288779:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42d0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1873906360257280:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1787096558.288780:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cf200/0x1b9fb40e15b43db9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.288789:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d6e9cf200 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:1.0:1787096558.288791:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cf200/0x1b9fb40e15b43db9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.288795:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cf200/0x1b9fb40e15b43db9 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6480 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.288812:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3:0x0].0x0 (ffff9c9d48c61e00) 00010000:00010000:1.0:1787096558.288814:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096558.288816:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cf200/0x1b9fb40e15b43db9 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.288820:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cf200/0x1b9fb40e15b43db9 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096558.288834:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787096558.288835:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cee00/0x1b9fb40e15b43dc0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.288840:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cee00/0x1b9fb40e15b43dc0 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787096558.288852:0:7417:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 5 committed batchid 0 00010000:00010000:1.0:1787096558.288854:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cee00/0x1b9fb40e15b43dc0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.288860:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d6e9cee00 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:1.0:1787096558.288862:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cee00/0x1b9fb40e15b43dc0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.288867:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cee00/0x1b9fb40e15b43dc0 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6480 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096558.288870:0:6466:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360257280 00010000:00010000:1.0:1787096558.288873:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0x0 (ffff9c9d48c61c00) 00010000:00010000:1.0:1787096558.288875:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787096558.288875:0:6466:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360257280 00010000:00010000:1.0:1787096558.288880:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cee00/0x1b9fb40e15b43dc0 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.288884:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cee00/0x1b9fb40e15b43dc0 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.288898:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4b200/0x1b9fb40e15b43e4c lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x5:0x0].0xae2548a7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.288905:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4b200/0x1b9fb40e15b43e4c lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x5:0x0].0xae2548a7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096558.288911:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00010000:00010000:1.0:1787096558.288917:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4b200/0x1b9fb40e15b43e4c lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x5:0x0].0xae2548a7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096558.288923:0:6466:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d500a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+7:3628:x1873906360257280:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1787096558.288929:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d7ca4b200 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:1.0:1787096558.288933:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4b200/0x1b9fb40e15b43e4c lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x5:0x0].0xae2548a7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096558.288934:0:6466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787096558.288949:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce600/0x1b9fb40e15b43d49 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x1b9fb40e15b43d42 expref: 7 pid: 7409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.288952:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4b200/0x1b9fb40e15b43e4c lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x5:0x0].0xae2548a7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096558.288970:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa5d0027 (ffff9c9d48c61d00) 00010000:00010000:1.0:1787096558.288972:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0xae2548a7 (ffff9c9d6b340a00) 00010000:00010000:1.0:1787096558.288977:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096558.288980:0:6466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787096558.288981:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4b200/0x1b9fb40e15b43e4c lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x5:0x0].0xae2548a7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.288988:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4b200/0x1b9fb40e15b43e4c lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x5:0x0].0xae2548a7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787096558.288997:0:7417:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00010000:00010000:1.0:1787096558.289004:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9ce400/0x1b9fb40e15b43ed1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x5:0x0].0xae2548a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096558.289013:0:6466:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d500a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+6:3628:x1873906360257280:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 91us (180us total) trans 0 rc 0/0 00010000:00010000:1.0:1787096558.289014:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9ce400/0x1b9fb40e15b43ed1 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x5:0x0].0xae2548a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096558.289028:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:1.0:1787096558.289029:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9ce400/0x1b9fb40e15b43ed1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x5:0x0].0xae2548a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.289047:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d6e9ce400 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:1.0:1787096558.289051:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9ce400/0x1b9fb40e15b43ed1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x5:0x0].0xae2548a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.289057:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9ce400/0x1b9fb40e15b43ed1 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x5:0x0].0xae2548a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.289066:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0xae2548a7 (ffff9c9d6b340a00) 00010000:00010000:1.0:1787096558.289069:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096558.289072:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9ce400/0x1b9fb40e15b43ed1 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x5:0x0].0xae2548a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.289086:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9ce400/0x1b9fb40e15b43ed1 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x5:0x0].0xae2548a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096558.289089:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42d0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1873906360257280:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1787096558.289112:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ccea800/0x1b9fb40e15b43f6b lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6481 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.289118:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ccea800/0x1b9fb40e15b43f6b lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6481 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.289125:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ccea800/0x1b9fb40e15b43f6b lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6481 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.289129:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d7ccea800 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:1.0:1787096558.289132:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ccea800/0x1b9fb40e15b43f6b lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6481 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.289138:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ccea800/0x1b9fb40e15b43f6b lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6481 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.289147:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x5:0x0].0x0 (ffff9c9d6b35ce00) 00010000:00010000:1.0:1787096558.289150:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096558.289153:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ccea800/0x1b9fb40e15b43f6b lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6481 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.289158:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ccea800/0x1b9fb40e15b43f6b lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6481 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.289167:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ccebe00/0x1b9fb40e15b43f72 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6481 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.289174:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ccebe00/0x1b9fb40e15b43f72 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6481 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.289186:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ccebe00/0x1b9fb40e15b43f72 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6481 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.289192:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d7ccebe00 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:1.0:1787096558.289195:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ccebe00/0x1b9fb40e15b43f72 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6481 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.289201:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ccebe00/0x1b9fb40e15b43f72 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6481 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.289210:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x6:0x0].0x0 (ffff9c9d6b35cf00) 00010000:00010000:1.0:1787096558.289212:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096558.289215:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ccebe00/0x1b9fb40e15b43f72 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6481 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.289221:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ccebe00/0x1b9fb40e15b43f72 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6481 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.289236:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7cceba00/0x1b9fb40e15b43ffe lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.289242:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7cceba00/0x1b9fb40e15b43ffe lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.289248:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7cceba00/0x1b9fb40e15b43ffe lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.289253:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d7cceba00 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:1.0:1787096558.289256:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7cceba00/0x1b9fb40e15b43ffe lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.289273:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7cceba00/0x1b9fb40e15b43ffe lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6480 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.289282:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x6:0x0].0xdd5a5043 (ffff9c9d6b35c400) 00010000:00010000:1.0:1787096558.289285:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096558.289287:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7cceba00/0x1b9fb40e15b43ffe lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.289293:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7cceba00/0x1b9fb40e15b43ffe lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096558.704323:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1787096558.704363:0:7414:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352844160 00000100:00100000:2.0:1787096558.704373:0:7414:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352844160 00000100:00100000:2.0:1787096558.704495:0:7414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 193 00000100:00080000:3.0F:1787096558.704500:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787096558.704507:0:7414:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42d0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47c5a664-3f41-4887-ab67-ea7db94c9f90+6:35349:x1873906352844160:12345-192.168.203.27@tcp:101:rm.0 00010000:00010000:2.0:1787096558.704534:0:7414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096558.704554:0:7414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4a000/0x1b9fb40e15b44021 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc6ce1 expref: -99 pid: 7414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096558.704612:0:7414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4b400/0x1b9fb40e15b44028 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096558.704625:0:7414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4b400/0x1b9fb40e15b44028 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7414 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096558.704638:0:7414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4b400/0x1b9fb40e15b44028 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7414 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787096558.704716:0:7414:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000402:0x5:0x0]: returning size 4096 00000004:00200000:2.0:1787096558.704721:0:7414:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:2.0:1787096558.704744:0:7414:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4b400/0x1b9fb40e15b44028 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7414 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096558.704767:0:7414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4a000/0x1b9fb40e15b44021 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6ce1 expref: 8 pid: 7414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096558.704786:0:7414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4b400/0x1b9fb40e15b44028 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6ce1 expref: 7 pid: 7414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096558.704821:0:7414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x5:0x0].0x0 (ffff9c9d6b35ce00) 00010000:00010000:2.0:1787096558.704824:0:7414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787096558.704828:0:7414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d7ca4b400, rc 0) 00000100:00100000:2.0:1787096558.704875:0:7414:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42d0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47c5a664-3f41-4887-ab67-ea7db94c9f90+7:35349:x1873906352844160:12345-192.168.203.27@tcp:101:rm.0 Request processed in 372us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096558.704882:0:7414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 193 00000100:00100000:0.0:1787096558.706271:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1787096558.706326:0:6479:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352844288 00000100:00100000:3.0:1787096558.706342:0:6479:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352844288 00000100:00100000:3.0:1787096558.706450:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 194 00000100:00100000:3.0:1787096558.706465:0:6479:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42d09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47c5a664-3f41-4887-ab67-ea7db94c9f90+7:35349:x1873906352844288:12345-192.168.203.27@tcp:101:rm.0 00010000:00010000:3.0:1787096558.706487:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787096558.706512:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2000/0x1b9fb40e15b4402f lrc: 2/0,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc6ce8 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.706660:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac3000/0x1b9fb40e15b44036 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.706675:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac3000/0x1b9fb40e15b44036 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.706688:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac3000/0x1b9fb40e15b44036 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787096558.706740:0:6479:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000400:0x6:0x0]: returning size 4096 00000004:00200000:3.0:1787096558.706746:0:6479:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1787096558.706784:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2000/0x1b9fb40e15b4402f lrc: 0/0,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6ce8 expref: 9 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.706814:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac3000/0x1b9fb40e15b44036 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6ce8 expref: 8 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.706825:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x6:0x0].0x0 (ffff9c9d6b3f0900) 00010000:00010000:3.0:1787096558.706828:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787096558.706832:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d6eac3000, rc 0) 00000100:00100000:3.0:1787096558.706899:0:6479:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42d09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47c5a664-3f41-4887-ab67-ea7db94c9f90+8:35349:x1873906352844288:12345-192.168.203.27@tcp:101:rm.0 Request processed in 439us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096558.706916:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 194 00000100:00100000:2.0:1787096558.708583:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1787096558.708624:0:18819:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352844544 00000100:00100000:3.0:1787096558.708632:0:18819:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352844544 00000100:00100000:3.0:1787096558.708693:0:18819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 195 00000100:00100000:3.0:1787096558.708707:0:18819:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42cb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:47c5a664-3f41-4887-ab67-ea7db94c9f90+8:35349:x1873906352844544:12345-192.168.203.27@tcp:101:rm.0 00010000:00010000:3.0:1787096558.708720:0:18819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787096558.708733:0:18819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac3800/0x1b9fb40e15b4403d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc6cef expref: -99 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787096558.708881:0:18819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000402:0x5:0x0]: returning size 4096 00010000:00010000:3.0:1787096558.709007:0:18819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac3800/0x1b9fb40e15b4403d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6cef expref: 10 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.709021:0:18819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9d6b3f0c00) 00010000:00010000:3.0:1787096558.709024:0:18819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787096558.709027:0:18819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac3800/0x1b9fb40e15b4403d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6cef expref: 10 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.709042:0:18819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d6eac3800, rc 0) 00000100:00100000:3.0:1787096558.709091:0:18819:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42cb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:47c5a664-3f41-4887-ab67-ea7db94c9f90+9:35349:x1873906352844544:12345-192.168.203.27@tcp:101:rm.0 Request processed in 391us (511us total) trans 4294967320 rc 301/301 00000100:00100000:3.0:1787096558.709096:0:18819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 195 00000100:00100000:0.0:1787096558.711220:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1787096558.711263:0:13479:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352844672 00000100:00100000:3.0:1787096558.711273:0:13479:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352844672 00000100:00100000:3.0:1787096558.711324:0:13479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 32 00000100:00100000:3.0:1787096558.711337:0:13479:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d6b32bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:47c5a664-3f41-4887-ab67-ea7db94c9f90+9:35349:x1873906352844672:12345-192.168.203.27@tcp:37:rm.0 00000100:00100000:3.0:1787096558.713669:0:13479:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d6b32bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:47c5a664-3f41-4887-ab67-ea7db94c9f90+9:35349:x1873906352844672:12345-192.168.203.27@tcp:37:rm.0 Request processed in 2327us (2448us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096558.713682:0:13479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 32 00000100:00100000:2.0:1787096558.715997:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1787096558.716053:0:6483:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352844800 00000100:00100000:3.0:1787096558.716068:0:6483:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352844800 00000100:00100000:3.0:1787096558.716137:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 33 00000100:00100000:3.0:1787096558.716147:0:6483:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42cb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47c5a664-3f41-4887-ab67-ea7db94c9f90+8:35349:x1873906352844800:12345-192.168.203.27@tcp:37:rm.0 00000100:00080000:1.0:1787096558.717245:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787096558.718658:0:6483:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42cb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47c5a664-3f41-4887-ab67-ea7db94c9f90+8:35349:x1873906352844800:12345-192.168.203.27@tcp:37:rm.0 Request processed in 2504us (2658us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096558.718673:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 33 00000100:00100000:2.0:1787096558.721028:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1787096558.721073:0:13479:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352845056 00000100:00100000:3.0:1787096558.721083:0:13479:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352845056 00000100:00100000:3.0:1787096558.721130:0:13479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 34 00000100:00100000:3.0:1787096558.721141:0:13479:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42cb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:47c5a664-3f41-4887-ab67-ea7db94c9f90+9:35349:x1873906352845056:12345-192.168.203.27@tcp:35:rm.0 00000100:00100000:3.0:1787096558.721342:0:13479:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42cb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:47c5a664-3f41-4887-ab67-ea7db94c9f90+10:35349:x1873906352845056:12345-192.168.203.27@tcp:35:rm.0 Request processed in 201us (315us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1787096558.721350:0:13479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 34 00000100:00100000:2.0:1787096558.722475:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1787096558.722525:0:6481:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352845312 00000100:00100000:0.0:1787096558.722531:0:6481:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352845312 00000100:00100000:0.0:1787096558.722586:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 196 00000100:00100000:0.0:1787096558.722597:0:6481:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d6e98d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47c5a664-3f41-4887-ab67-ea7db94c9f90+10:35349:x1873906352845312:12345-192.168.203.27@tcp:101:rm.0 00010000:00010000:0.0:1787096558.722615:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787096558.722636:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ccea400/0x1b9fb40e15b4404b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc6cf6 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096558.722761:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7cceb800/0x1b9fb40e15b44052 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096558.722775:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7cceb800/0x1b9fb40e15b44052 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6481 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096558.722787:0:6481:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7cceb800/0x1b9fb40e15b44052 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6481 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787096558.722810:0:6481:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000402:0x5:0x0]: returning size 4096 00010000:00010000:0.0:1787096558.722885:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ccea400/0x1b9fb40e15b4404b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6cf6 expref: 13 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096558.722905:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7cceb800/0x1b9fb40e15b44052 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6cf6 expref: 12 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096558.722927:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x5:0x0].0x0 (ffff9c9d6b35ce00) 00010000:00010000:0.0:1787096558.722931:0:6481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787096558.722934:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d7cceb800, rc 0) 00000100:00100000:0.0:1787096558.722977:0:6481:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d6e98d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47c5a664-3f41-4887-ab67-ea7db94c9f90+12:35349:x1873906352845312:12345-192.168.203.27@tcp:101:rm.0 Request processed in 382us (501us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1787096558.722996:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 196 00000100:00100000:0.0:1787096558.724496:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1787096558.724543:0:6480:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352845440 00000100:00100000:3.0:1787096558.724550:0:6480:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352845440 00000100:00100000:3.0:1787096558.724606:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 197 00000100:00100000:3.0:1787096558.724615:0:6480:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47c5a664-3f41-4887-ab67-ea7db94c9f90+8:35349:x1873906352845440:12345-192.168.203.27@tcp:41:rm.0 00000004:00000024:3.0:1787096558.724650:0:6480:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 7847059456 avail 7384014848 00000100:00100000:3.0:1787096558.724687:0:6480:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47c5a664-3f41-4887-ab67-ea7db94c9f90+8:35349:x1873906352845440:12345-192.168.203.27@tcp:41:rm.0 Request processed in 75us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096558.724692:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 197 00000100:00100000:2.0:1787096558.725674:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1787096558.725727:0:9995:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352845568 00000100:00100000:3.0:1787096558.725733:0:9995:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352845568 00000100:00100000:3.0:1787096558.725776:0:9995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 198 00000100:00100000:3.0:1787096558.725786:0:9995:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d506fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47c5a664-3f41-4887-ab67-ea7db94c9f90+12:35349:x1873906352845568:12345-192.168.203.27@tcp:101:rm.0 00010000:00010000:3.0:1787096558.725814:0:9995:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787096558.725831:0:9995:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac3800/0x1b9fb40e15b44060 lrc: 2/0,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc6cfd expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.725882:0:9995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2000/0x1b9fb40e15b44067 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.725895:0:9995:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2000/0x1b9fb40e15b44067 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.725906:0:9995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2000/0x1b9fb40e15b44067 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.725919:0:9995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2c00/0x1b9fb40e15b4406e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.725927:0:9995:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2c00/0x1b9fb40e15b4406e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.725934:0:9995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2c00/0x1b9fb40e15b4406e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.726001:0:9995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2400/0x1b9fb40e15b44075 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.726009:0:9995:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2400/0x1b9fb40e15b44075 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.726028:0:9995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2400/0x1b9fb40e15b44075 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787096558.726061:0:9995:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000402:0x6:0x0]: returning size 0 00000004:00200000:3.0:1787096558.726065:0:9995:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787096558.726080:0:9995:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2400/0x1b9fb40e15b44075 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.726090:0:9995:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2400/0x1b9fb40e15b44075 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.726109:0:9995:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2000/0x1b9fb40e15b44067 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.726117:0:9995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2000/0x1b9fb40e15b44067 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.726124:0:9995:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2000/0x1b9fb40e15b44067 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.726130:0:9995:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2000/0x1b9fb40e15b44067 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.726137:0:9995:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d6eac2000 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:3.0:1787096558.726141:0:9995:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2000/0x1b9fb40e15b44067 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.726148:0:9995:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2000/0x1b9fb40e15b44067 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.726161:0:9995:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x6:0x0].0x0 (ffff9c9d6b3f0900) 00010000:00010000:3.0:1787096558.726164:0:9995:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096558.726176:0:9995:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2000/0x1b9fb40e15b44067 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.726182:0:9995:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2000/0x1b9fb40e15b44067 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.726195:0:9995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2c00/0x1b9fb40e15b4406e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.726201:0:9995:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2c00/0x1b9fb40e15b4406e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.726207:0:9995:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2c00/0x1b9fb40e15b4406e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.726212:0:9995:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d6eac2c00 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:3.0:1787096558.726216:0:9995:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2c00/0x1b9fb40e15b4406e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.726221:0:9995:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2c00/0x1b9fb40e15b4406e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.726231:0:9995:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x6:0x0].0xdd5a5043 (ffff9c9d6b3f0c00) 00010000:00010000:3.0:1787096558.726233:0:9995:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096558.726237:0:9995:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2c00/0x1b9fb40e15b4406e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.726242:0:9995:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2c00/0x1b9fb40e15b4406e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.726274:0:9995:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac3800/0x1b9fb40e15b44060 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6cfd expref: 14 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.726313:0:9995:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2400/0x1b9fb40e15b44075 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6cfd expref: 13 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.726323:0:9995:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x0 (ffff9c9d6b3f0d00) 00010000:00010000:3.0:1787096558.726326:0:9995:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787096558.726328:0:9995:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d6eac2400, rc 0) 00000100:00100000:3.0:1787096558.726369:0:9995:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d506fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47c5a664-3f41-4887-ab67-ea7db94c9f90+13:35349:x1873906352845568:12345-192.168.203.27@tcp:101:rm.0 Request processed in 585us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096558.726377:0:9995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 198 00000100:00100000:2.0:1787096558.727885:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1787096558.727927:0:7414:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352845824 00000100:00100000:1.0:1787096558.727935:0:7414:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352845824 00000100:00100000:1.0:1787096558.727981:0:7414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 199 00000100:00100000:1.0:1787096558.727991:0:7414:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d506ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47c5a664-3f41-4887-ab67-ea7db94c9f90+13:35349:x1873906352845824:12345-192.168.203.27@tcp:36:rm.0 00010000:00010000:1.0:1787096558.728031:0:7414:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1787096558.728046:0:7414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2400/0x1b9fb40e15b44075 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6cfd expref: 13 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.728057:0:7414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x0 (ffff9c9d6b3f0d00) 00010000:00010000:1.0:1787096558.728075:0:7414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac3000/0x1b9fb40e15b44036 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6ce8 expref: 12 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.728082:0:7414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x6:0x0].0x0 (ffff9c9d6b3f0900) 00010000:00010000:1.0:1787096558.728086:0:7414:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787096558.728098:0:7414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9ce800/0x1b9fb40e15b4407c lrc: 3/0,1 mode: --/CW res: [0x240000400:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.728112:0:7414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9ce800/0x1b9fb40e15b4407c lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7414 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.728117:0:7414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9ce800/0x1b9fb40e15b4407c lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7414 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.728125:0:7414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cf000/0x1b9fb40e15b44083 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.728129:0:7414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cf000/0x1b9fb40e15b44083 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7414 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.728132:0:7414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cf000/0x1b9fb40e15b44083 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7414 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.728180:0:7414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cf800/0x1b9fb40e15b4408a lrc: 3/0,1 mode: --/EX res: [0x240000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.728185:0:7414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cf800/0x1b9fb40e15b4408a lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7414 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.728188:0:7414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cf800/0x1b9fb40e15b4408a lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7414 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.728374:0:7414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cea00/0x1b9fb40e15b44091 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.728383:0:7414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cea00/0x1b9fb40e15b44091 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7414 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.728623:0:7414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cea00/0x1b9fb40e15b44091 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7414 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.728640:0:7414:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cea00/0x1b9fb40e15b44091 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7414 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.728646:0:7414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cea00/0x1b9fb40e15b44091 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7414 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.728652:0:7414:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cea00/0x1b9fb40e15b44091 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7414 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.728671:0:7414:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787096558.728688:0:7414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cf800/0x1b9fb40e15b4408a lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7414 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096558.728692:0:7403:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787096558.728695:0:7414:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cf800/0x1b9fb40e15b4408a lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7414 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096558.728700:0:7403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cea00/0x1b9fb40e15b44091 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 7414 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.728701:0:7414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cf800/0x1b9fb40e15b4408a lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7414 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.728711:0:7414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d6e9cf800 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:1.0:1787096558.728715:0:7414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cf800/0x1b9fb40e15b4408a lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7414 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096558.728717:0:7403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d6e9cea00 already unused, calling callback (ffffffffc0dbb6f0) 00010000:00010000:1.0:1787096558.728722:0:7414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cf800/0x1b9fb40e15b4408a lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7414 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096558.728723:0:7403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cea00/0x1b9fb40e15b44091 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 7414 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.728736:0:7414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x0 (ffff9c9d48c61800) 00010000:00010000:1.0:1787096558.728738:0:7414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787096558.728741:0:7414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cf800/0x1b9fb40e15b4408a lrc: 2/0,0 mode: --/EX res: [0x240000402:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7414 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096558.728744:0:7403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cea00/0x1b9fb40e15b44091 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 7414 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.728760:0:7414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cf800/0x1b9fb40e15b4408a lrc: 0/0,0 mode: --/EX res: [0x240000402:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7414 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096558.728766:0:7403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x0 (ffff9c9d48c61800) 00010000:00010000:0.0:1787096558.728770:0:7403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787096558.728773:0:7414:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9ce800/0x1b9fb40e15b4407c lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7414 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096558.728774:0:7403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cea00/0x1b9fb40e15b44091 lrc: 1/0,0 mode: --/PW res: [0x240000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7414 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.728791:0:7414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9ce800/0x1b9fb40e15b4407c lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7414 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096558.728792:0:7403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cea00/0x1b9fb40e15b44091 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7414 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.728814:0:7414:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9ce800/0x1b9fb40e15b4407c lrc: 3/0,0 mode: CW/CW res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7414 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.728821:0:7414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9ce800/0x1b9fb40e15b4407c lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7414 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.728826:0:7414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d6e9ce800 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:0.0:1787096558.728827:0:7403:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787096558.728829:0:7414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9ce800/0x1b9fb40e15b4407c lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7414 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096558.728830:0:7403:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787096558.728833:0:7403:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787096558.728838:0:7414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9ce800/0x1b9fb40e15b4407c lrc: 5/0,0 mode: CW/CW res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7414 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.728847:0:7414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x6:0x0].0x0 (ffff9c9d48c61c00) 00010000:00010000:1.0:1787096558.728849:0:7414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096558.728852:0:7414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9ce800/0x1b9fb40e15b4407c lrc: 3/0,0 mode: --/CW res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7414 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.728858:0:7414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9ce800/0x1b9fb40e15b4407c lrc: 0/0,0 mode: --/CW res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7414 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787096558.728871:0:7414:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000c6c1eeae reply state 000000001785c61e transno 4294967323 ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cf000/0x1b9fb40e15b44083 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7414 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.728888:0:7414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cf000/0x1b9fb40e15b44083 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7414 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.728895:0:7414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x6:0x0].0xdd5a5043 (ffff9c9d48c61e00) 00010000:00010000:1.0:1787096558.728898:0:7414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787096558.728900:0:7414:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787096558.728960:0:7414:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d506ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47c5a664-3f41-4887-ab67-ea7db94c9f90+13:35349:x1873906352845824:12345-192.168.203.27@tcp:36:rm.0 Request processed in 970us (1078us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1787096558.728968:0:7414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 199 00000100:00100000:1.0:1787096558.730308:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1787096558.730336:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1787096558.730344:0:7855:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352845952 00000100:00100000:0.0:1787096558.730350:0:7855:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352845952 00000100:00100000:2.0:1787096558.730376:0:6483:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352846208 00000100:00100000:2.0:1787096558.730380:0:6483:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352846208 00000100:00100000:0.0:1787096558.730419:0:7855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 16 00000100:00100000:0.0:1787096558.730432:0:7855:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7fa99180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:47c5a664-3f41-4887-ab67-ea7db94c9f90+8:2402:x1873906352845952:12345-192.168.203.27@tcp:103:rm.0 00000100:00100000:2.0:1787096558.730439:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 35 00010000:00010000:0.0:1787096558.730443:0:7855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1787096558.730458:0:6483:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7fa98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47c5a664-3f41-4887-ab67-ea7db94c9f90+13:35349:x1873906352846208:12345-192.168.203.27@tcp:35:rm.0 00010000:00010000:0.0:1787096558.730464:0:7855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce200/0x1b9fb40e15b43faa lrc: 0/0,0 mode: --/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6cb0 expref: 8 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096558.730475:0:7855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x5:0x0].0x0 (ffff9c9d48c61100) 00010000:00010000:0.0:1787096558.730480:0:7855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787096558.730510:0:7855:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7fa99180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:47c5a664-3f41-4887-ab67-ea7db94c9f90+7:2402:x1873906352845952:12345-192.168.203.27@tcp:103:rm.0 Request processed in 84us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096558.730516:0:7855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 16 00000100:00100000:2.0:1787096558.730609:0:6483:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7fa98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47c5a664-3f41-4887-ab67-ea7db94c9f90+14:35349:x1873906352846208:12345-192.168.203.27@tcp:35:rm.0 Request processed in 161us (270us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1787096558.730617:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 35 00000100:00100000:2.0:1787096558.732489:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1787096558.732532:0:6479:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352846464 00000100:00100000:0.0:1787096558.732540:0:6479:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352846464 00000100:00100000:0.0:1787096558.732611:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 200 00000100:00100000:0.0:1787096558.732622:0:6479:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d506fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47c5a664-3f41-4887-ab67-ea7db94c9f90+14:35349:x1873906352846464:12345-192.168.203.27@tcp:36:rm.0 00010000:00010000:0.0:1787096558.732670:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787096558.732692:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7cceb800/0x1b9fb40e15b44052 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6cf6 expref: 14 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096558.732710:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4b400/0x1b9fb40e15b44028 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6ce1 expref: 13 pid: 7414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096558.732722:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4be00/0x1b9fb40e15b43fb8 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x5:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6cb7 expref: 12 pid: 7414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096558.732732:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x5:0x0].0x0 (ffff9c9d6b35ce00) 00010000:00010000:0.0:1787096558.732749:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787096558.732789:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ccea400/0x1b9fb40e15b44098 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096558.732797:0:6479:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ccea400/0x1b9fb40e15b44098 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 6479 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096558.732830:0:6479:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ccea400/0x1b9fb40e15b44098 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 6479 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096558.732852:0:6479:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42d0aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6479:1873906360257408:0@lo:101:mdt00_000.0 00000100:00100000:0.0:1787096558.732892:0:6479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096558.732924:0:7409:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360257408 00000100:00100000:2.0:1787096558.732929:0:7409:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360257408 00000100:00100000:0.0:1787096558.732939:0:6479:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9c42ca4240 going to sleep for 11 seconds 00000100:00100000:2.0:1787096558.732965:0:7409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1787096558.732972:0:7409:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42d09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:6479:x1873906360257408:12345-0@lo:101:mdt00_000.0 00010000:00010000:2.0:1787096558.732983:0:7409:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096558.733001:0:7409:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a200/0x1b9fb40e15b4409f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b9fb40e15b44098 expref: -99 pid: 7409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096558.733024:0:7409:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea000/0x1b9fb40e15b43f8e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6ca9 expref: 6 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096558.733034:0:7409:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a200/0x1b9fb40e15b4409f lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x1b9fb40e15b44098 expref: 7 pid: 7409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096558.733056:0:7409:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea000/0x1b9fb40e15b43f8e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6ca9 expref: 6 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096558.733068:0:7409:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea000/0x1b9fb40e15b43f8e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6ca9 expref: 6 pid: 6480 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096558.733080:0:7409:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d506ff800 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:7409:1873906360257536:192.168.203.27@tcp:104: 00000100:00100000:2.0:1787096558.733137:0:7409:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9d6e9a6480 going to sleep for 11 seconds 00000100:00100000:0.0:1787096558.735274:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1787096558.735297:0:7409:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d506ff800 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:7409:1873906360257536:192.168.203.27@tcp:104: 00010000:00010000:2.0:1787096558.735320:0:7409:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a200/0x1b9fb40e15b4409f lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1b9fb40e15b44098 expref: 7 pid: 7409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096558.735324:0:8378:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352846592 00010000:00010000:2.0:1787096558.735331:0:7409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9c41286000) 00000100:00100000:1.0:1787096558.735331:0:8378:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352846592 00010000:00010000:2.0:1787096558.735335:0:7409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096558.735338:0:7409:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a200/0x1b9fb40e15b4409f lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1b9fb40e15b44098 expref: 7 pid: 7409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096558.735345:0:7409:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d7ca4a200, rc 0) 00010000:00010000:1.0:1787096558.735361:0:8378:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea000/0x1b9fb40e15b43f8e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6ca9 expref: 7 pid: 6480 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096558.735386:0:7409:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42d09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:6479:x1873906360257408:12345-0@lo:101:mdt00_000.0 Request processed in 2415us (2493us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096558.735416:0:7409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1787096558.735434:0:8378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 75 00000100:00100000:3.0:1787096558.735435:0:6479:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42d0aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6479:1873906360257408:0@lo:101:mdt00_000.0 00000100:00100000:1.0:1787096558.735444:0:8378:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7bf28a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:47c5a664-3f41-4887-ab67-ea7db94c9f90+7:2402:x1873906352846592:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787096558.735450:0:6479:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ccea400/0x1b9fb40e15b44098 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1b9fb40e15b4409f expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.735456:0:8378:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787096558.735459:0:6479:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ccea400/0x1b9fb40e15b44098 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b9fb40e15b4409f expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.735462:0:8378:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea000/0x1b9fb40e15b43f8e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6ca9 expref: 7 pid: 6480 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.735474:0:8378:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea000/0x1b9fb40e15b43f8e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6ca9 expref: 7 pid: 6480 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.735493:0:8378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea000/0x1b9fb40e15b43f8e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6ca9 expref: 7 pid: 6480 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.735515:0:8378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9c41286000) 00010000:00010000:1.0:1787096558.735520:0:8378:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a200/0x1b9fb40e15b4409f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1b9fb40e15b44098 expref: 6 pid: 7409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.735530:0:8378:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a200/0x1b9fb40e15b4409f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x1b9fb40e15b44098 expref: 6 pid: 7409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.735550:0:8378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a200/0x1b9fb40e15b4409f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x1b9fb40e15b44098 expref: 6 pid: 7409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.735577:0:8378:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a200/0x1b9fb40e15b4409f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1b9fb40e15b44098 expref: 6 pid: 7409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096558.735587:0:8378:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d7fa99c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:8378:1873906360257664:0@lo:105: 00000100:00100000:1.0:1787096558.735615:0:8378:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096558.735649:0:8378:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9d6e9f8840 going to sleep for 11 seconds 00000100:00100000:2.0:1787096558.735657:0:6463:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360257664 00000100:00100000:2.0:1787096558.735661:0:6463:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360257664 00000100:00100000:2.0:1787096558.735687:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787096558.735693:0:6463:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7fa98700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:8378:x1873906360257664:12345-0@lo:105: 00010000:00010000:2.0:1787096558.735700:0:6463:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ccea400/0x1b9fb40e15b44098 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b9fb40e15b4409f expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096558.735708:0:6463:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ccea400/0x1b9fb40e15b44098 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b9fb40e15b4409f expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096558.735717:0:6463:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ccea400/0x1b9fb40e15b44098 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1b9fb40e15b4409f expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096558.735725:0:6463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ccea400/0x1b9fb40e15b44098 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x1b9fb40e15b4409f expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096558.735732:0:6463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ccea400/0x1b9fb40e15b44098 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x1b9fb40e15b4409f expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096558.735739:0:6463:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ccea400/0x1b9fb40e15b44098 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x1b9fb40e15b4409f expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096558.735758:0:6463:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9c9d7ccea400) 00010000:00010000:3.0:1787096558.735777:0:6479:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ccea400/0x1b9fb40e15b44098 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b9fb40e15b4409f expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.735787:0:6479:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ccea400/0x1b9fb40e15b44098 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b9fb40e15b4409f expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096558.735793:0:6463:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7fa98700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:8378:x1873906360257664:12345-0@lo:105: Request processed in 98us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096558.735815:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000004:00080000:3.0:1787096558.735823:0:6479:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:1.0:1787096558.735836:0:8378:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d7fa99c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:8378:1873906360257664:0@lo:105: 00010000:00010000:1.0:1787096558.735852:0:8378:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787096558.735854:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac3800/0x1b9fb40e15b440a6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.735871:0:6479:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac3800/0x1b9fb40e15b440a6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6479 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.735880:0:6479:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac3800/0x1b9fb40e15b440a6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6479 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096558.735889:0:8378:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7bf28a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:47c5a664-3f41-4887-ab67-ea7db94c9f90+6:2402:x1873906352846592:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 446us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096558.735898:0:6479:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42d71500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6479:1873906360257792:0@lo:101:mdt00_000.0 00000100:00100000:1.0:1787096558.735901:0:8378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 75 00000100:00100000:3.0:1787096558.735935:0:6479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096558.735957:0:6479:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9c42d53300 going to sleep for 11 seconds 00000100:00100000:1.0:1787096558.735961:0:7723:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360257792 00000100:00100000:1.0:1787096558.735967:0:7723:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360257792 00000100:00100000:1.0:1787096558.736000:0:7723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1787096558.736010:0:7723:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42d71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+7:6479:x1873906360257792:12345-0@lo:101:mdt00_000.0 00010000:00010000:1.0:1787096558.736025:0:7723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096558.736046:0:7723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce800/0x1b9fb40e15b440ad lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b9fb40e15b440a6 expref: -99 pid: 7723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.736064:0:7723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce800/0x1b9fb40e15b440ad lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x1b9fb40e15b440a6 expref: 8 pid: 7723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.736074:0:7723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce800/0x1b9fb40e15b440ad lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1b9fb40e15b440a6 expref: 8 pid: 7723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.736082:0:7723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb790e34b (ffff9c9d48c61c00) 00010000:00010000:1.0:1787096558.736085:0:7723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096558.736087:0:7723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d6e9ce800, rc 0) 00000100:00100000:1.0:1787096558.736123:0:7723:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42d71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:6479:x1873906360257792:12345-0@lo:101:mdt00_000.0 Request processed in 116us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096558.736129:0:7723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1787096558.736146:0:6479:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42d71500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6479:1873906360257792:0@lo:101:mdt00_000.0 00010000:00010000:3.0:1787096558.736155:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac3800/0x1b9fb40e15b440a6 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1b9fb40e15b440ad expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.736161:0:6479:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac3800/0x1b9fb40e15b440a6 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b9fb40e15b440ad expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787096558.736169:0:6479:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:3.0:1787096558.736193:0:6479:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42d71500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6479:1873906360257920:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787096558.736215:0:6479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096558.736234:0:6479:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9c42d53e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787096558.736248:0:6485:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360257920 00000100:00100000:1.0:1787096558.736253:0:6485:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360257920 00000100:00100000:1.0:1787096558.736286:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1787096558.736294:0:6485:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42d0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:6479:x1873906360257920:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787096558.736352:0:6485:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42d0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:6479:x1873906360257920:12345-0@lo:1000:mdt00_000.0 Request processed in 60us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096558.736357:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1787096558.736376:0:6479:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42d71500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6479:1873906360257920:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787096558.736438:0:6479:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42d71500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6479:1873906360258048:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787096558.736462:0:6479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096558.736477:0:6479:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9c42d53e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787096558.736481:0:6484:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360258048 00000100:00100000:1.0:1787096558.736485:0:6484:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360258048 00000100:00100000:1.0:1787096558.736510:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1787096558.736516:0:6484:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42dcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:6479:x1873906360258048:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787096558.736596:0:6479:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42d71500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6479:1873906360258048:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787096558.736599:0:6484:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42dcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:6479:x1873906360258048:12345-0@lo:1000:mdt00_000.0 Request processed in 81us (134us total) trans 0 rc 1/1 00000100:00100000:1.0:1787096558.736616:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00010000:00010000:3.0:1787096558.736643:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac2c00/0x1b9fb40e15b440b4 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.736655:0:6479:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac2c00/0x1b9fb40e15b440b4 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6479 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.736661:0:6479:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac2c00/0x1b9fb40e15b440b4 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6479 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096558.736669:0:6479:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42d71500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6479:1873906360258176:0@lo:101:mdt00_000.0 00000100:00100000:3.0:1787096558.736684:0:6479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096558.736698:0:6479:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9c42d53300 going to sleep for 11 seconds 00000100:00100000:2.0:1787096558.736721:0:7409:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360258176 00000100:00100000:2.0:1787096558.736725:0:7409:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360258176 00000100:00100000:2.0:1787096558.736747:0:7409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1787096558.736754:0:7409:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d512d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:6479:x1873906360258176:12345-0@lo:101:mdt00_000.0 00010000:00010000:2.0:1787096558.736762:0:7409:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096558.736772:0:7409:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4aa00/0x1b9fb40e15b440bb lrc: 2/0,0 mode: --/EX res: [0x240000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b9fb40e15b440b4 expref: -99 pid: 7409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096558.736787:0:7409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4aa00/0x1b9fb40e15b440bb lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x1b9fb40e15b440b4 expref: 9 pid: 7409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096558.736796:0:7409:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4aa00/0x1b9fb40e15b440bb lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1b9fb40e15b440b4 expref: 9 pid: 7409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096558.736815:0:7409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x5:0x0].0x0 (ffff9c9d6b340c00) 00010000:00010000:2.0:1787096558.736818:0:7409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787096558.736820:0:7409:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d7ca4aa00, rc 0) 00000100:00100000:2.0:1787096558.736848:0:7409:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d512d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:6479:x1873906360258176:12345-0@lo:101:mdt00_000.0 Request processed in 95us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096558.736856:0:7409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1787096558.736864:0:6479:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42d71500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6479:1873906360258176:0@lo:101:mdt00_000.0 00010000:00010000:3.0:1787096558.736873:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac2c00/0x1b9fb40e15b440b4 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1b9fb40e15b440bb expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.736880:0:6479:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac2c00/0x1b9fb40e15b440b4 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b9fb40e15b440bb expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.736901:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2000/0x1b9fb40e15b440c2 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.736908:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2000/0x1b9fb40e15b440c2 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.736917:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2000/0x1b9fb40e15b440c2 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.736933:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac3400/0x1b9fb40e15b440c9 lrc: 3/0,1 mode: --/EX res: [0x240000400:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.736940:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac3400/0x1b9fb40e15b440c9 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.736953:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac3400/0x1b9fb40e15b440c9 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.736973:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac3e00/0x1b9fb40e15b440d0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.736978:0:6479:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac3e00/0x1b9fb40e15b440d0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6479 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.736983:0:6479:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac3e00/0x1b9fb40e15b440d0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6479 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096558.736990:0:6479:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42d71500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6479:1873906360258304:0@lo:101:mdt00_000.0 00000100:00100000:3.0:1787096558.737006:0:6479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096558.737019:0:6479:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9c42d53300 going to sleep for 11 seconds 00000100:00100000:2.0:1787096558.737045:0:7723:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360258304 00000100:00100000:2.0:1787096558.737048:0:7723:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360258304 00000100:00100000:2.0:1787096558.737070:0:7723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1787096558.737076:0:7723:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7fab2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:6479:x1873906360258304:12345-0@lo:101:mdt00_000.0 00010000:00010000:2.0:1787096558.737085:0:7723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096558.737093:0:7723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ac00/0x1b9fb40e15b440d7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b9fb40e15b440d0 expref: -99 pid: 7723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096558.737110:0:7723:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2800/0x1b9fb40e15b43fd4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6cc5 expref: 5 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096558.737126:0:7723:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ac00/0x1b9fb40e15b440d7 lrc: 4/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x1b9fb40e15b440d0 expref: 10 pid: 7723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096558.737146:0:7723:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2800/0x1b9fb40e15b43fd4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6cc5 expref: 5 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096558.737155:0:7723:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2800/0x1b9fb40e15b43fd4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6cc5 expref: 5 pid: 18819 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096558.737163:0:7723:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d506ff800 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:7723:1873906360258432:192.168.203.27@tcp:104: 00000100:00100000:2.0:1787096558.737220:0:7723:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9d6e9a6480 going to sleep for 11 seconds 00000100:00100000:1.0:1787096558.738457:0:7723:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d506ff800 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:7723:1873906360258432:192.168.203.27@tcp:104: 00010000:00010000:1.0:1787096558.738477:0:7723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ac00/0x1b9fb40e15b440d7 lrc: 3/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1b9fb40e15b440d0 expref: 10 pid: 7723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.738486:0:7723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c9d6b3f0000) 00010000:00010000:1.0:1787096558.738489:0:7723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787096558.738493:0:7723:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ac00/0x1b9fb40e15b440d7 lrc: 3/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1b9fb40e15b440d0 expref: 10 pid: 7723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.738502:0:7723:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ac00/0x1b9fb40e15b440d7 lrc: 3/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1b9fb40e15b440d0 expref: 10 pid: 7723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.738510:0:7723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d7ca4ac00, rc 0) 00000100:00100000:1.0:1787096558.738552:0:7723:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7fab2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+10:6479:x1873906360258304:12345-0@lo:101:mdt00_000.0 Request processed in 1475us (1542us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096558.738559:0:7723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1787096558.738642:0:6479:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42d71500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6479:1873906360258304:0@lo:101:mdt00_000.0 00010000:00010000:3.0:1787096558.738657:0:6479:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac3e00/0x1b9fb40e15b440d0 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1b9fb40e15b440d7 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.738668:0:6479:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac3e00/0x1b9fb40e15b440d0 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b9fb40e15b440d7 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096558.738694:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1787096558.738721:0:9435:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352846720 00000100:00100000:3.0:1787096558.738727:0:9435:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352846720 00010000:00010000:3.0:1787096558.738790:0:9435:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2800/0x1b9fb40e15b43fd4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6cc5 expref: 6 pid: 18819 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096558.738837:0:9435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 76 00000100:00100000:3.0:1787096558.738846:0:9435:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d506ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:47c5a664-3f41-4887-ab67-ea7db94c9f90+6:2402:x1873906352846720:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787096558.738862:0:9435:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787096558.738869:0:9435:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2800/0x1b9fb40e15b43fd4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6cc5 expref: 6 pid: 18819 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.738882:0:9435:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2800/0x1b9fb40e15b43fd4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6cc5 expref: 6 pid: 18819 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.738899:0:9435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2800/0x1b9fb40e15b43fd4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6cc5 expref: 6 pid: 18819 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.738911:0:9435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c9d6b3f0000) 00010000:00010000:3.0:1787096558.738916:0:9435:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ac00/0x1b9fb40e15b440d7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1b9fb40e15b440d0 expref: 9 pid: 7723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.738925:0:9435:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ac00/0x1b9fb40e15b440d7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x1b9fb40e15b440d0 expref: 9 pid: 7723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.738933:0:9435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ac00/0x1b9fb40e15b440d7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x1b9fb40e15b440d0 expref: 9 pid: 7723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.738956:0:9435:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ac00/0x1b9fb40e15b440d7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1b9fb40e15b440d0 expref: 9 pid: 7723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096558.738967:0:9435:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d7fab1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000_UUID:9435:1873906360258560:0@lo:105: 00000100:00100000:3.0:1787096558.739001:0:9435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096558.739039:0:7402:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360258560 00000100:00100000:2.0:1787096558.739044:0:7402:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360258560 00000100:00100000:3.0:1787096558.739046:0:9435:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9c42d53300 going to sleep for 11 seconds 00000100:00100000:2.0:1787096558.739077:0:7402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787096558.739085:0:7402:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42e63100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:9435:x1873906360258560:12345-0@lo:105: 00010000:00010000:2.0:1787096558.739095:0:7402:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac3e00/0x1b9fb40e15b440d0 lrc: 5/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b9fb40e15b440d7 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096558.739105:0:7402:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac3e00/0x1b9fb40e15b440d0 lrc: 5/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b9fb40e15b440d7 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096558.739110:0:7402:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac3e00/0x1b9fb40e15b440d0 lrc: 5/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1b9fb40e15b440d7 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096558.739115:0:7402:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac3e00/0x1b9fb40e15b440d0 lrc: 5/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x1b9fb40e15b440d7 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096558.739126:0:7402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac3e00/0x1b9fb40e15b440d0 lrc: 6/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x1b9fb40e15b440d7 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096558.739131:0:7402:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac3e00/0x1b9fb40e15b440d0 lrc: 6/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x1b9fb40e15b440d7 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096558.739145:0:7402:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9c9d6eac3e00) 00010000:00010000:3.0:1787096558.739162:0:6479:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac3e00/0x1b9fb40e15b440d0 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b9fb40e15b440d7 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.739178:0:6479:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac3e00/0x1b9fb40e15b440d0 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b9fb40e15b440d7 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096558.739186:0:7402:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42e63100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:9435:x1873906360258560:12345-0@lo:105: Request processed in 101us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096558.739204:0:7402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787096558.739214:0:9435:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d7fab1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000_UUID:9435:1873906360258560:0@lo:105: 00010000:00010000:1.0:1787096558.739231:0:9435:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787096558.739270:0:9435:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d506ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:47c5a664-3f41-4887-ab67-ea7db94c9f90+5:2402:x1873906352846720:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 424us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096558.739279:0:9435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 76 00000100:00100000:3.0:1787096558.740075:0:6479:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42d71500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6479:1873906360258688:0@lo:403:mdt00_000.0 00000100:00100000:3.0:1787096558.740115:0:6479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096558.740134:0:6479:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9c42d53e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787096558.740156:0:6485:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360258688 00000100:00100000:1.0:1787096558.740162:0:6485:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360258688 00000100:00100000:1.0:1787096558.740211:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1787096558.740220:0:6485:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d75981180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:6479:x1873906360258688:12345-0@lo:403:mdt00_000.0 00000100:00100000:1.0:1787096558.742084:0:6485:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d75981180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:6479:x1873906360258688:12345-0@lo:403:mdt00_000.0 Request processed in 1861us (1963us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096558.742094:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1787096558.742112:0:6479:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42d71500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6479:1873906360258688:0@lo:403:mdt00_000.0 00000040:00080000:3.0:1787096558.743040:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].6, 936 off42032 00000040:00080000:3.0:1787096558.743206:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].6, 1016 off42872 00000004:00080000:3.0:1787096558.743211:0:6479:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9c9c42d53e40 with version 9 00000004:00080000:1.0:1787096558.743262:0:7407:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff9c9d589526c0 version 9 rpc_version 9 00000020:00100000:1.0:1787096558.743290:0:7407:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787096558.743299:0:7407:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9c9d7fa99c00 x1873906360258944/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2592/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787096558.743321:0:7407:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d7fa99c00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7407:1873906360258944:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787096558.743363:0:7407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096558.743421:0:7407:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9d6e9f8840 going to sleep for 11 seconds 00000100:00100000:3.0:1787096558.743453:0:6484:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360258944 00000100:00100000:3.0:1787096558.743460:0:6484:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360258944 00000100:00100000:3.0:1787096558.743496:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1787096558.743506:0:6484:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7fa9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:7407:x1873906360258944:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787096558.743918:0:6484:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7fa9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:7407:x1873906360258944:12345-0@lo:1000:osp_up0-1.0 Request processed in 413us (554us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1787096558.743926:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1787096558.743965:0:7407:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d7fa99c00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7407:1873906360258944:0@lo:1000:osp_up0-1.0 00000004:00200000:3.0:1787096558.743979:0:6479:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000402:0x5:0x0]: returning size 4096 00010000:00010000:3.0:1787096558.743996:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac3400/0x1b9fb40e15b440c9 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.744005:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac3400/0x1b9fb40e15b440c9 lrc: 2/0,0 mode: EX/EX res: [0x240000400:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.744011:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac3400/0x1b9fb40e15b440c9 lrc: 3/0,0 mode: EX/EX res: [0x240000400:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.744023:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d6eac3400 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:3.0:1787096558.744026:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac3400/0x1b9fb40e15b440c9 lrc: 3/0,0 mode: EX/EX res: [0x240000400:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.744032:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac3400/0x1b9fb40e15b440c9 lrc: 4/0,0 mode: EX/EX res: [0x240000400:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.744044:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x6:0x0].0x0 (ffff9c9d6b3f0e00) 00010000:00010000:3.0:1787096558.744046:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787096558.744049:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac3400/0x1b9fb40e15b440c9 lrc: 2/0,0 mode: --/EX res: [0x240000400:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.744053:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac3400/0x1b9fb40e15b440c9 lrc: 0/0,0 mode: --/EX res: [0x240000400:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.744068:0:6479:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac3e00/0x1b9fb40e15b440d0 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b9fb40e15b440d7 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.744074:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac3e00/0x1b9fb40e15b440d0 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x1b9fb40e15b440d7 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.744078:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac3e00/0x1b9fb40e15b440d0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x1b9fb40e15b440d7 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.744094:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1787096558.744099:0:6479:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000401:0x6:0x0] 00010000:00010000:3.0:1787096558.744102:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2000/0x1b9fb40e15b440c2 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.744106:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2000/0x1b9fb40e15b440c2 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.744113:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2000/0x1b9fb40e15b440c2 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.744116:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d6eac2000 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:3.0:1787096558.744118:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2000/0x1b9fb40e15b440c2 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.744122:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2000/0x1b9fb40e15b440c2 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096558.744122:0:6468:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787096558.744131:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x5:0x0].0x0 (ffff9c9d6b3f0500) 00010000:00010000:0.0:1787096558.744132:0:6468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac3e00/0x1b9fb40e15b440d0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x1b9fb40e15b440d7 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.744133:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096558.744136:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2000/0x1b9fb40e15b440c2 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.744147:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2000/0x1b9fb40e15b440c2 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096558.744151:0:6468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d6eac3e00 already unused, calling callback (ffffffffc1953ee0) 00010000:00010000:3.0:1787096558.744159:0:6479:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac2c00/0x1b9fb40e15b440b4 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b9fb40e15b440bb expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096558.744159:0:6468:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac3e00/0x1b9fb40e15b440d0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x1b9fb40e15b440d7 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.744177:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac2c00/0x1b9fb40e15b440b4 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x1b9fb40e15b440bb expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787096558.744180:0:6468:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac3e00/0x1b9fb40e15b440d0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x1b9fb40e15b440d7 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.744185:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac2c00/0x1b9fb40e15b440b4 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x1b9fb40e15b440bb expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.744210:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1787096558.744218:0:6479:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1787096558.744221:0:6468:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac3e00/0x1b9fb40e15b440d0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1b9fb40e15b440d7 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.744223:0:6479:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ccea400/0x1b9fb40e15b44098 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b9fb40e15b4409f expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096558.744229:0:6468:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787096558.744230:0:8377:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787096558.744235:0:8377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac2c00/0x1b9fb40e15b440b4 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x1b9fb40e15b440bb expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.744240:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ccea400/0x1b9fb40e15b44098 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x1b9fb40e15b4409f expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.744242:0:8377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d6eac2c00 already unused, calling callback (ffffffffc1953ee0) 00010000:00010000:1.0:1787096558.744246:0:8377:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac2c00/0x1b9fb40e15b440b4 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x1b9fb40e15b440bb expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.744247:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ccea400/0x1b9fb40e15b44098 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x1b9fb40e15b4409f expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787096558.744254:0:8377:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac2c00/0x1b9fb40e15b440b4 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x1b9fb40e15b440bb expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096558.744254:0:6468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac3e00/0x1b9fb40e15b440d0 lrc: 1/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1b9fb40e15b440d7 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.744272:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787096558.744278:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac3e00/0x1b9fb40e15b440d0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1b9fb40e15b440d7 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787096558.744280:0:6479:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1787096558.744285:0:8377:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac2c00/0x1b9fb40e15b440b4 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1b9fb40e15b440bb expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.744289:0:8376:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787096558.744295:0:8376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ccea400/0x1b9fb40e15b44098 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x1b9fb40e15b4409f expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.744296:0:8377:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787096558.744309:0:8376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d7ccea400 already unused, calling callback (ffffffffc1953ee0) 00010000:00010000:3.0:1787096558.744315:0:8376:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ccea400/0x1b9fb40e15b44098 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x1b9fb40e15b4409f expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.744315:0:8377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac2c00/0x1b9fb40e15b440b4 lrc: 1/0,0 mode: --/EX res: [0x240000402:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1b9fb40e15b440bb expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787096558.744323:0:8376:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ccea400/0x1b9fb40e15b44098 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x1b9fb40e15b4409f expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096558.744326:0:6468:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787096558.744328:0:8377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac2c00/0x1b9fb40e15b440b4 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1b9fb40e15b440bb expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096558.744330:0:6468:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787096558.744334:0:6468:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787096558.744342:0:8376:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ccea400/0x1b9fb40e15b44098 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1b9fb40e15b4409f expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.744348:0:8376:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787096558.744350:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d7bf29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1873906360259072:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787096558.744351:0:8377:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787096558.744353:0:8377:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787096558.744356:0:8376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ccea400/0x1b9fb40e15b44098 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1b9fb40e15b4409f expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.744356:0:8377:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787096558.744363:0:8376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ccea400/0x1b9fb40e15b44098 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1b9fb40e15b4409f expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096558.744371:0:3625:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d7fa99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1873906360259200:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787096558.744382:0:8376:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787096558.744385:0:8376:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787096558.744388:0:8376:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787096558.744420:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac3800/0x1b9fb40e15b440a6 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1b9fb40e15b440ad expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096558.744431:0:6479:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac3800/0x1b9fb40e15b440a6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1b9fb40e15b440ad expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096558.744431:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096558.744436:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d75982680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1873906360259328:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787096558.744489:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096558.744495:0:6479:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d506fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47c5a664-3f41-4887-ab67-ea7db94c9f90+12:35349:x1873906352846464:12345-192.168.203.27@tcp:36:rm.0 Request processed in 11875us (12009us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1787096558.744505:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 200 00000100:00100000:0.0:1787096558.744510:0:7855:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360259072 00000100:00100000:0.0:1787096558.744516:0:7855:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360259072 00000100:00100000:0.0:1787096558.744554:0:7855:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360259328 00000100:00100000:0.0:1787096558.744557:0:7855:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360259328 00000100:00100000:1.0:1787096558.744573:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787096558.744584:0:6465:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7bf28700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+12:3628:x1873906360259072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787096558.744596:0:6465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1787096558.744596:0:7855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787096558.744608:0:7855:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7fab1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+12:3626:x1873906360259328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787096558.744616:0:7855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787096558.744626:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ac00/0x1b9fb40e15b440d7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x1b9fb40e15b440d0 expref: 12 pid: 7723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096558.744631:0:7855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a200/0x1b9fb40e15b4409f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x1b9fb40e15b44098 expref: 12 pid: 7409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.744643:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c9d6b3f0000) 00010000:00010000:0.0:1787096558.744650:0:7855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9c41286000) 00010000:00010000:1.0:1787096558.744655:0:6465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787096558.744655:0:7855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787096558.744706:0:6465:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7bf28700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+10:3628:x1873906360259072:12345-0@lo:103:ldlm_bl.0 Request processed in 124us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096558.744708:0:7855:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7fab1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+10:3626:x1873906360259328:12345-0@lo:103:ldlm_bl.0 Request processed in 103us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096558.744718:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787096558.744724:0:7855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787096558.744774:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096558.744782:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d7bf29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1873906360259072:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787096558.744844:0:6466:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360259200 00000100:00100000:1.0:1787096558.744848:0:6466:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360259200 00000100:00100000:0.0:1787096558.744879:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d75982680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1873906360259328:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787096558.744886:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787096558.744895:0:6466:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7bf2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+9:3625:x1873906360259200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787096558.744904:0:6466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787096558.744920:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4aa00/0x1b9fb40e15b440bb lrc: 0/0,0 mode: --/EX res: [0x240000402:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x1b9fb40e15b440b4 expref: 9 pid: 7409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096558.744931:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x5:0x0].0x0 (ffff9c9d6b340c00) 00010000:00010000:1.0:1787096558.744938:0:6466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787096558.744973:0:6466:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7bf2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+8:3625:x1873906360259200:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096558.744979:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787096558.745125:0:3625:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d7fa99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1873906360259200:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787096559.234242:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1787096559.234272:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1787096559.234292:0:6475:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352846848 00000100:00100000:3.0:1787096559.234302:0:6475:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352846848 00000100:00100000:2.0:1787096559.234311:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1787096559.234336:0:18819:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352846976 00000100:00100000:0.0:1787096559.234342:0:18819:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352846976 00000100:00100000:3.0:1787096559.234367:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 329 00000100:00100000:1.0:1787096559.234368:0:9995:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352847104 00000100:00100000:1.0:1787096559.234374:0:9995:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352847104 00000100:00100000:3.0:1787096559.234380:0:6475:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d51327850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:911fcbfa-c40d-448b-aa47-1f7570bacebd+9:2400:x1873906352846848:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:0.0:1787096559.234413:0:18819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 232 00000100:00100000:0.0:1787096559.234425:0:18819:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7beda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:47c5a664-3f41-4887-ab67-ea7db94c9f90+5:2399:x1873906352846976:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1787096559.234441:0:9995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 233 00000100:00100000:1.0:1787096559.234451:0:9995:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d5129c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47c5a664-3f41-4887-ab67-ea7db94c9f90+12:2400:x1873906352847104:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1787096559.234484:0:6475:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d51327850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:911fcbfa-c40d-448b-aa47-1f7570bacebd+9:2400:x1873906352846848:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 106us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096559.234486:0:18819:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7beda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:47c5a664-3f41-4887-ab67-ea7db94c9f90+5:2399:x1873906352846976:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 63us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096559.234495:0:9995:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d5129c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47c5a664-3f41-4887-ab67-ea7db94c9f90+12:2400:x1873906352847104:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 42us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096559.234502:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 329 00000100:00100000:0.0:1787096559.234503:0:18819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 232 00000100:00100000:1.0:1787096559.234512:0:9995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 233 00000001:02000400:1.0:1787096559.305544:0:22511:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 24a: reject --ec with --comp-add ======= 19:42:39 (1787096559) 00010000:00010000:1.0:1787096559.310483:0:6469:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787096559.374622:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1787096559.374678:0:6480:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352847232 00000100:00100000:2.0:1787096559.374688:0:6480:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352847232 00000100:00100000:2.0:1787096559.374737:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 201 00000100:00100000:2.0:1787096559.374744:0:6480:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d75982680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47c5a664-3f41-4887-ab67-ea7db94c9f90+5:35522:x1873906352847232:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:2.0:1787096559.374763:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096559.374778:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ac00/0x1b9fb40e15b440de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc6d04 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096559.374850:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a200/0x1b9fb40e15b440e5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096559.374864:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a200/0x1b9fb40e15b440e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096559.374892:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a200/0x1b9fb40e15b440e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787096559.374931:0:6480:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787096559.374933:0:6480:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787096559.374951:0:6480:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a200/0x1b9fb40e15b440e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096559.374972:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ac00/0x1b9fb40e15b440de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6d04 expref: 7 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096559.374987:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a200/0x1b9fb40e15b440e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6d04 expref: 6 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096559.374994:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9c41286000) 00010000:00010000:2.0:1787096559.374997:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787096559.375001:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d7ca4a200, rc 0) 00000100:00100000:2.0:1787096559.375059:0:6480:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d75982680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47c5a664-3f41-4887-ab67-ea7db94c9f90+6:35522:x1873906352847232:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 315us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096559.375066:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 201 00000100:00100000:2.0:1787096559.376461:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1787096559.376512:0:6481:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352847360 00000100:00100000:0.0:1787096559.376519:0:6481:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352847360 00000100:00100000:0.0:1787096559.376570:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 202 00000100:00100000:0.0:1787096559.376653:0:6481:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d5129f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47c5a664-3f41-4887-ab67-ea7db94c9f90+6:35522:x1873906352847360:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:0.0:1787096559.376668:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787096559.376680:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceb800/0x1b9fb40e15b440ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc6d0b expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.376722:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceac00/0x1b9fb40e15b440f3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.376732:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceac00/0x1b9fb40e15b440f3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.376741:0:6481:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceac00/0x1b9fb40e15b440f3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.376754:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea800/0x1b9fb40e15b440fa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.376761:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea800/0x1b9fb40e15b440fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.376768:0:6481:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea800/0x1b9fb40e15b440fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.376817:0:6481:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceac00/0x1b9fb40e15b440f3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.376833:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceac00/0x1b9fb40e15b440f3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.376838:0:6481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceac00/0x1b9fb40e15b440f3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.376844:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceac00/0x1b9fb40e15b440f3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.376850:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d7cceac00 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:0.0:1787096559.376854:0:6481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceac00/0x1b9fb40e15b440f3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.376861:0:6481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceac00/0x1b9fb40e15b440f3 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.376872:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9c41286000) 00010000:00010000:0.0:1787096559.376875:0:6481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096559.376879:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceac00/0x1b9fb40e15b440f3 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.376885:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceac00/0x1b9fb40e15b440f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.376895:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea800/0x1b9fb40e15b440fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.376901:0:6481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea800/0x1b9fb40e15b440fa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.376906:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea800/0x1b9fb40e15b440fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.376916:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d7ccea800 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:0.0:1787096559.376919:0:6481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea800/0x1b9fb40e15b440fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.376925:0:6481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea800/0x1b9fb40e15b440fa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.376932:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2e9bf99 (ffff9c9d820d2500) 00010000:00010000:0.0:1787096559.376935:0:6481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096559.376938:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea800/0x1b9fb40e15b440fa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.376943:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea800/0x1b9fb40e15b440fa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.376970:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceb800/0x1b9fb40e15b440ec lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6d0b expref: 7 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.376980:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9c41286000) 00010000:00010000:0.0:1787096559.376982:0:6481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096559.376985:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceb800/0x1b9fb40e15b440ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6d0b expref: 7 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.376994:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d7cceb800, rc 0) 00000100:00100000:0.0:1787096559.377040:0:6481:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d5129f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47c5a664-3f41-4887-ab67-ea7db94c9f90+6:35522:x1873906352847360:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 445us (582us total) trans 0 rc 301/301 00000100:00100000:0.0:1787096559.377046:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 202 00000100:00100000:1.0:1787096559.379445:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1787096559.379475:0:18819:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352847616 00000100:00100000:0.0:1787096559.379490:0:18819:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352847616 00000100:00100000:0.0:1787096559.379531:0:18819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 203 00000100:00100000:0.0:1787096559.379540:0:18819:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c41e6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:47c5a664-3f41-4887-ab67-ea7db94c9f90+6:35522:x1873906352847616:12345-192.168.203.27@tcp:36:lfs.0 00010000:00010000:0.0:1787096559.379586:0:18819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787096559.379617:0:18819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a200/0x1b9fb40e15b440e5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6d04 expref: 6 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.379634:0:18819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9c41286000) 00010000:00010000:0.0:1787096559.379642:0:18819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787096559.379679:0:18819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccebe00/0x1b9fb40e15b44101 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.379691:0:18819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccebe00/0x1b9fb40e15b44101 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.379700:0:18819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccebe00/0x1b9fb40e15b44101 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.379712:0:18819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceba00/0x1b9fb40e15b44108 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.379720:0:18819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceba00/0x1b9fb40e15b44108 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.379727:0:18819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceba00/0x1b9fb40e15b44108 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787096559.380582:0:18819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787096559.380620:0:18819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x1:0x0].1, 64 off32832 00000004:00080000:0.0:1787096559.380627:0:18819:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9c9c42ca4b40 with version 2 00000004:00080000:2.0:1787096559.380661:0:7720:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff9c9d4551c600 version 2 rpc_version 2 00000040:00080000:0.0:1787096559.380682:0:18819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00100000:2.0:1787096559.380693:0:7720:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787096559.380701:0:7720:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9c9d5129ea00 x1873906360259584/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000040:00080000:0.0:1787096559.380702:0:18819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x1:0x0].2, 64 off32896 00000004:00080000:0.0:1787096559.380710:0:18819:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9c9c42ca4780 with version 3 00000100:00100000:2.0:1787096559.380725:0:7720:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d5129ea00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7720:1873906360259584:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787096559.380779:0:7720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096559.380834:0:7720:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9d58a37780 going to sleep for 11 seconds 00000040:00080000:0.0:1787096559.381338:0:18819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787096559.381530:0:7409:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360259584 00000100:00100000:3.0:1787096559.381537:0:7409:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360259584 00000040:00080000:0.0:1787096559.381572:0:18819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x1:0x0].1, 64 off32832 00000100:00100000:3.0:1787096559.381592:0:7409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1787096559.381607:0:7409:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d5129d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7720:x1873906360259584:12345-0@lo:1000:osp_up1-0.0 00000040:00080000:0.0:1787096559.381771:0:18819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].1, 2152 off34920 00000040:00080000:0.0:1787096559.381881:0:18819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].1, 2352 off35120 00000004:00080000:0.0:1787096559.381887:0:18819:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9c9c42ca4900 with version 4 00010000:00010000:0.0:1787096559.383849:0:7392:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac3800/0x1b9fb40e15b440a6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x1b9fb40e15b440ad expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787096559.383865:0:7392:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac3800/0x1b9fb40e15b440a6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x1b9fb40e15b440ad expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.383896:0:7392:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac3800/0x1b9fb40e15b440a6 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1b9fb40e15b440ad expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.383903:0:7392:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787096559.383930:0:7392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac3800/0x1b9fb40e15b440a6 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1b9fb40e15b440ad expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787096559.383949:0:7392:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967326 is committed 00000100:00100000:2.0:1787096559.383955:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d7bf2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1873906360259712:0@lo:103:jbd2/dm-1-8.0 00000001:00080000:0.0:1787096559.383977:0:7392:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967325 is committed 00010000:00010000:1.0:1787096559.384001:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cf000/0x1b9fb40e15b44083 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7414 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787096559.384003:0:7392:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0001: 5 batchid updated 00000100:00100000:2.0:1787096559.384011:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787096559.384014:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cf000/0x1b9fb40e15b44083 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7414 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096559.384020:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cf000/0x1b9fb40e15b44083 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7414 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096559.384029:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d6e9cf000 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:1.0:1787096559.384034:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cf000/0x1b9fb40e15b44083 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7414 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096559.384050:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cf000/0x1b9fb40e15b44083 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7414 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1787096559.384054:0:7417:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 5 00010000:00010000:1.0:1787096559.384065:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x6:0x0].0xdd5a5043 (ffff9c9d48c61e00) 00010000:00010000:1.0:1787096559.384069:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096559.384075:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cf000/0x1b9fb40e15b44083 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7414 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096559.384081:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cf000/0x1b9fb40e15b44083 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7414 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787096559.384097:0:7417:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9c9d601dda80 with version 10 00000020:00080000:3.0:1787096559.384110:0:7417:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 1 cancel update log [0x200000401:0x3:0x0].1: rc = 0 00000100:00100000:1.0:1787096559.384119:0:6465:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360259712 00000004:00080000:0.0:1787096559.384122:0:7407:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff9c9d589526c0 version 10 rpc_version 10 00000100:00100000:1.0:1787096559.384127:0:6465:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360259712 00000020:00100000:0.0:1787096559.384143:0:7407:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787096559.384152:0:7407:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9c9d7bf29880 x1873906360259968/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00080000:3.0:1787096559.384162:0:7417:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 1 cancel update log [0x240000400:0x3:0x0].1: rc = 0 00000100:00100000:2.0:1787096559.384163:0:7409:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d5129d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7720:x1873906360259584:12345-0@lo:1000:osp_up1-0.0 Request processed in 2556us (3383us total) trans 4294967326 rc 0/0 00000100:00100000:0.0:1787096559.384173:0:7407:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d7bf29880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7407:1873906360259968:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787096559.384176:0:7409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1787096559.384180:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000004:00080000:3.0:1787096559.384190:0:7417:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9c9c42d329c0 with version 11 00000100:00100000:1.0:1787096559.384194:0:6465:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d500a8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+8:3627:x1873906360259712:12345-0@lo:103:jbd2/dm-1-8.0 00000020:00080000:3.0:1787096559.384195:0:7417:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 2 cancel update log [0x200000401:0x3:0x0].2: rc = 0 00010000:00010000:1.0:1787096559.384211:0:6465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1787096559.384222:0:7407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1787096559.384224:0:7720:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967326 committed transno 4294967326 00000100:00100000:2.0:1787096559.384228:0:7720:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967326 gen 2 00010000:00010000:1.0:1787096559.384229:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce800/0x1b9fb40e15b440ad lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x1b9fb40e15b440a6 expref: 8 pid: 7723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1787096559.384231:0:7417:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 2 cancel update log [0x240000400:0x3:0x0].2: rc = 0 00010000:00010000:1.0:1787096559.384247:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb790e34b (ffff9c9d48c61c00) 00000100:00100000:0.0:1787096559.384255:0:7407:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9c42ca4540 going to sleep for 11 seconds 00000100:00100000:2.0:1787096559.384257:0:7720:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d5129ea00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7720:1873906360259584:0@lo:1000:osp_up1-0.0 00010000:00010000:1.0:1787096559.384257:0:6465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:3.0:1787096559.384258:0:7417:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9c9c42d32a80 with version 12 00000020:00080000:3.0:1787096559.384263:0:7417:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 3 cancel update log [0x200000401:0x3:0x0].3: rc = 0 00000020:00080000:3.0:1787096559.384283:0:7417:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 3 cancel update log [0x240000400:0x3:0x0].3: rc = 0 00000004:00080000:2.0:1787096559.384296:0:7720:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff9c9d4551c600 version 3 rpc_version 3 00000004:00080000:3.0:1787096559.384302:0:7417:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9c9c42d320c0 with version 13 00000020:00080000:3.0:1787096559.384306:0:7417:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4 cancel update log [0x200000401:0x3:0x0].4: rc = 0 00000100:00100000:1.0:1787096559.384313:0:6465:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d500a8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+7:3627:x1873906360259712:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 123us (304us total) trans 0 rc 0/0 00000020:00100000:2.0:1787096559.384321:0:7720:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000020:00080000:3.0:1787096559.384328:0:7417:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4 cancel update log [0x240000400:0x3:0x0].4: rc = 0 00000100:00100000:2.0:1787096559.384329:0:7720:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9c9d5129ea00 x1873906360260224/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1312/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787096559.384333:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787096559.384336:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d7bf2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1873906360259712:0@lo:103:jbd2/dm-1-8.0 00000004:00080000:3.0:1787096559.384352:0:7417:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9c9c42d32e40 with version 14 00000020:00080000:3.0:1787096559.384355:0:7417:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 5 cancel update log [0x200000401:0x3:0x0].5: rc = 0 00000100:00100000:2.0:1787096559.384355:0:7720:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d5129ea00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7720:1873906360260224:0@lo:1000:osp_up1-0.0 00000020:00080000:3.0:1787096559.384376:0:7417:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 5 cancel update log [0x240000400:0x3:0x0].5: rc = 0 00000020:00080000:3.0:1787096559.384384:0:7417:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 5 00000100:00100000:2.0:1787096559.384387:0:7720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096559.384414:0:7723:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360259968 00000100:00100000:1.0:1787096559.384418:0:7723:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360259968 00000100:00100000:2.0:1787096559.384433:0:7720:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9d70ea0000 going to sleep for 11 seconds 00000100:00100000:1.0:1787096559.384450:0:7723:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360260224 00000100:00100000:1.0:1787096559.384453:0:7723:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360260224 00000100:00100000:1.0:1787096559.384480:0:7723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1787096559.384486:0:7723:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7485b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+7:7407:x1873906360259968:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787096559.384490:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1787096559.384503:0:6484:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42f99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7720:x1873906360260224:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787096559.384601:0:7723:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7485b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:7407:x1873906360259968:12345-0@lo:1000:osp_up0-1.0 Request processed in 114us (381us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1787096559.384608:0:7723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1787096559.384638:0:7407:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d7bf29880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7407:1873906360259968:0@lo:1000:osp_up0-1.0 00000004:00080000:2.0:1787096559.384649:0:7407:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff9c9d589526c0 version 11 rpc_version 11 00000020:00100000:2.0:1787096559.384661:0:7407:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787096559.384667:0:7407:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9c9c42f98380 x1873906360260480/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787096559.384682:0:7407:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42f98380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7407:1873906360260480:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787096559.384712:0:7407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096559.384734:0:7407:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9c42ca4540 going to sleep for 11 seconds 00000100:00100000:3.0:1787096559.384752:0:7409:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360260480 00000100:00100000:3.0:1787096559.384757:0:7409:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360260480 00000100:00100000:3.0:1787096559.384786:0:7409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1787096559.384792:0:7409:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42f99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:7407:x1873906360260480:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787096559.384879:0:7409:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42f99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:7407:x1873906360260480:12345-0@lo:1000:osp_up0-1.0 Request processed in 87us (167us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1787096559.384886:0:7409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1787096559.384908:0:7407:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42f98380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7407:1873906360260480:0@lo:1000:osp_up0-1.0 00000004:00080000:2.0:1787096559.384917:0:7407:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff9c9d589526c0 version 12 rpc_version 12 00000020:00100000:2.0:1787096559.384935:0:7407:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787096559.384940:0:7407:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9c9c42ccfb80 x1873906360260736/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787096559.384953:0:7407:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42ccfb80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7407:1873906360260736:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787096559.384987:0:7407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096559.385006:0:7407:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9c42ca4540 going to sleep for 11 seconds 00000100:00100000:1.0:1787096559.385031:0:7723:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360260736 00000100:00100000:1.0:1787096559.385036:0:7723:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360260736 00000100:00100000:1.0:1787096559.385060:0:7723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1787096559.385067:0:7723:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42ccf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:7407:x1873906360260736:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787096559.385140:0:7723:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42ccf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+10:7407:x1873906360260736:12345-0@lo:1000:osp_up0-1.0 Request processed in 72us (151us total) trans 4294967367 rc 0/0 00000100:00100000:1.0:1787096559.385148:0:7723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1787096559.385161:0:7407:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42ccfb80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7407:1873906360260736:0@lo:1000:osp_up0-1.0 00000004:00080000:2.0:1787096559.385169:0:7407:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff9c9d589526c0 version 13 rpc_version 13 00000020:00100000:2.0:1787096559.385188:0:7407:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787096559.385193:0:7407:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9c9c42ccc000 x1873906360260992/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787096559.385205:0:7407:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42ccc000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7407:1873906360260992:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787096559.385235:0:7407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096559.385250:0:7407:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9c42ca4540 going to sleep for 11 seconds 00000100:00100000:3.0:1787096559.385276:0:7409:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360260992 00000100:00100000:3.0:1787096559.385280:0:7409:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360260992 00000100:00100000:3.0:1787096559.385302:0:7409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1787096559.385307:0:7409:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42ccdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:7407:x1873906360260992:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787096559.385372:0:7409:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42ccdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:7407:x1873906360260992:12345-0@lo:1000:osp_up0-1.0 Request processed in 64us (135us total) trans 4294967368 rc 0/0 00000100:00100000:3.0:1787096559.385377:0:7409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1787096559.385431:0:7407:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42ccc000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7407:1873906360260992:0@lo:1000:osp_up0-1.0 00000004:00080000:2.0:1787096559.385444:0:7407:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff9c9d589526c0 version 14 rpc_version 14 00000020:00100000:2.0:1787096559.385454:0:7407:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787096559.385458:0:7407:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9c9d7dad7480 x1873906360261248/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787096559.385470:0:7407:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d7dad7480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7407:1873906360261248:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787096559.385491:0:7407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096559.385513:0:7407:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9c42ca4540 going to sleep for 11 seconds 00000100:00100000:1.0:1787096559.385550:0:7723:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360261248 00000100:00100000:1.0:1787096559.385555:0:7723:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360261248 00000100:00100000:1.0:1787096559.385583:0:7723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1787096559.385592:0:7723:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7dad4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+11:7407:x1873906360261248:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787096559.385654:0:7723:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7dad4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:7407:x1873906360261248:12345-0@lo:1000:osp_up0-1.0 Request processed in 64us (162us total) trans 4294967369 rc 0/0 00000100:00100000:1.0:1787096559.385659:0:7723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1787096559.385682:0:7407:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d7dad7480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7407:1873906360261248:0@lo:1000:osp_up0-1.0 00000001:00080000:2.0:1787096559.387066:0:7392:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967327 is committed 00000100:00100000:0.0:1787096559.387152:0:6484:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42f99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7720:x1873906360260224:12345-0@lo:1000:osp_up1-0.0 Request processed in 2653us (2764us total) trans 4294967327 rc 0/0 00000100:00100000:0.0:1787096559.387159:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000004:00080000:2.0:1787096559.387173:0:7720:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967327 committed transno 4294967327 00000100:00100000:2.0:1787096559.387181:0:7720:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967327 gen 2 00000100:00100000:2.0:1787096559.387194:0:7720:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d5129ea00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7720:1873906360260224:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1787096559.387212:0:7720:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff9c9d4551c600 version 4 rpc_version 4 00000020:00100000:2.0:1787096559.387241:0:7720:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787096559.387247:0:7720:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9c9d5129ea00 x1873906360261504/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787096559.387262:0:7720:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d5129ea00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7720:1873906360261504:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787096559.387296:0:7720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096559.387323:0:7720:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9c42ca4cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787096559.387347:0:7409:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360261504 00000100:00100000:3.0:1787096559.387353:0:7409:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360261504 00000100:00100000:3.0:1787096559.387409:0:7409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1787096559.387420:0:7409:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d6ea18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7720:x1873906360261504:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787096559.388164:0:7409:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d6ea18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7720:x1873906360261504:12345-0@lo:1000:osp_up1-0.0 Request processed in 746us (865us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1787096559.388172:0:7409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1787096559.388210:0:7720:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d5129ea00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7720:1873906360261504:0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1787096559.388305:0:18819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceb800/0x1b9fb40e15b4410f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.388318:0:18819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceb800/0x1b9fb40e15b4410f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.388326:0:18819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceb800/0x1b9fb40e15b4410f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.388338:0:18819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea800/0x1b9fb40e15b44116 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.388342:0:18819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea800/0x1b9fb40e15b44116 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.388346:0:18819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea800/0x1b9fb40e15b44116 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.388363:0:18819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9c9d7cceac00/0x1b9fb40e15b4411d lrc: 3/0,1 mode: --/PW res: [0x240000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.388367:0:18819:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9c9d7cceac00/0x1b9fb40e15b4411d lrc: 3/0,1 mode: --/PW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.388380:0:18819:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9c9d7cceac00/0x1b9fb40e15b4411d lrc: 3/0,1 mode: --/PW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096559.388425:0:18819:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d74859880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:18819:1873906360261632:0@lo:101:mdt00_005.0 00000100:00100000:0.0:1787096559.388451:0:18819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096559.388483:0:7723:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360261632 00000100:00100000:1.0:1787096559.388487:0:7723:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360261632 00000100:00100000:0.0:1787096559.388489:0:18819:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9c41e4b780 going to sleep for 11 seconds 00000100:00100000:1.0:1787096559.388526:0:7723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1787096559.388533:0:7723:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d74859c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:18819:x1873906360261632:12345-0@lo:101:mdt00_005.0 00010000:00010000:1.0:1787096559.388545:0:7723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096559.389766:0:7723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9ce000/0x1b9fb40e15b44124 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b9fb40e15b4411d expref: -99 pid: 7723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096559.389815:0:7723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9ce000/0x1b9fb40e15b44124 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x1b9fb40e15b4411d expref: 7 pid: 7723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096559.389827:0:7723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9ce000/0x1b9fb40e15b44124 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1b9fb40e15b4411d expref: 7 pid: 7723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096559.389836:0:7723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x2:0x0].0x0 (ffff9c9d48c61a00) 00010000:00010000:1.0:1787096559.389839:0:7723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096559.389842:0:7723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d6e9ce000, rc 0) 00000100:00100000:1.0:1787096559.389900:0:7723:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d74859c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+7:18819:x1873906360261632:12345-0@lo:101:mdt00_005.0 Request processed in 1367us (1447us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096559.389907:0:7723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1787096559.389989:0:18819:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d74859880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:18819:1873906360261632:0@lo:101:mdt00_005.0 00010000:00010000:0.0:1787096559.390004:0:18819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9c9d7cceac00/0x1b9fb40e15b4411d lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1b9fb40e15b44124 expref: -99 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.390015:0:18819:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9c9d7cceac00/0x1b9fb40e15b4411d lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b9fb40e15b44124 expref: -99 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787096559.390037:0:18819:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000000e834b95 reply state 0000000084abd6e0 transno 4294967364 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea800/0x1b9fb40e15b44116 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.390048:0:18819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea800/0x1b9fb40e15b44116 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.390054:0:18819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x2:0x0].0x0 (ffff9c9d6b35c400) 00010000:00010000:0.0:1787096559.390057:0:18819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787096559.390061:0:18819:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787096559.390067:0:18819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9c9d7cceac00/0x1b9fb40e15b4411d lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1b9fb40e15b44124 expref: -99 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.390075:0:18819:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff9c9d7cceac00/0x1b9fb40e15b4411d lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1b9fb40e15b44124 expref: -99 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787096559.390095:0:18819:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x2:0x0] 00000004:00010000:0.0:1787096559.390104:0:18819:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000000e834b95 reply state 0000000084abd6e0 transno 4294967364 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceb800/0x1b9fb40e15b4410f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.390113:0:18819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceb800/0x1b9fb40e15b4410f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.390119:0:18819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff9c9d6b35ce00) 00010000:00010000:0.0:1787096559.390122:0:18819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787096559.390123:0:18819:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:0.0:1787096559.390129:0:18819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x12:0x0]: returning size 4096 00010000:00010000:0.0:1787096559.390137:0:18819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccebe00/0x1b9fb40e15b44101 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.390143:0:18819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccebe00/0x1b9fb40e15b44101 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.390148:0:18819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccebe00/0x1b9fb40e15b44101 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.390155:0:18819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccebe00/0x1b9fb40e15b44101 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.390161:0:18819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d7ccebe00 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:0.0:1787096559.390165:0:18819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccebe00/0x1b9fb40e15b44101 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.390172:0:18819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccebe00/0x1b9fb40e15b44101 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.390182:0:18819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9c41286000) 00010000:00010000:0.0:1787096559.390190:0:18819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096559.390194:0:18819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccebe00/0x1b9fb40e15b44101 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.390200:0:18819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccebe00/0x1b9fb40e15b44101 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787096559.390210:0:18819:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000000e834b95 reply state 0000000084abd6e0 transno 4294967364 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceba00/0x1b9fb40e15b44108 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.390219:0:18819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceba00/0x1b9fb40e15b44108 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.390224:0:18819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2e9bf99 (ffff9c9d820d2100) 00010000:00010000:0.0:1787096559.390226:0:18819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787096559.390228:0:18819:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:0.0:1787096559.390295:0:18819:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c41e6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:47c5a664-3f41-4887-ab67-ea7db94c9f90+7:35522:x1873906352847616:12345-192.168.203.27@tcp:36:lfs.0 Request processed in 10754us (10852us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1787096559.390302:0:18819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 203 00000100:00100000:3.0:1787096559.403369:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1787096559.403433:0:6479:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352847744 00000100:00100000:0.0:1787096559.403444:0:6479:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352847744 00000100:00100000:0.0:1787096559.403506:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 204 00000100:00100000:0.0:1787096559.403517:0:6479:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7fa99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47c5a664-3f41-4887-ab67-ea7db94c9f90+7:35525:x1873906352847744:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:0.0:1787096559.403554:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787096559.403574:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccebe00/0x1b9fb40e15b4412b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc6d12 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.403634:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea600/0x1b9fb40e15b44132 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.403655:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea600/0x1b9fb40e15b44132 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.403678:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea600/0x1b9fb40e15b44132 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787096559.403720:0:6479:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787096559.403723:0:6479:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787096559.403742:0:6479:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea600/0x1b9fb40e15b44132 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.403764:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccebe00/0x1b9fb40e15b4412b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6d12 expref: 9 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.403779:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea600/0x1b9fb40e15b44132 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6d12 expref: 8 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.403788:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9c41286000) 00010000:00010000:0.0:1787096559.403791:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787096559.403806:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d7ccea600, rc 0) 00000100:00100000:0.0:1787096559.403861:0:6479:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7fa99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47c5a664-3f41-4887-ab67-ea7db94c9f90+8:35525:x1873906352847744:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 346us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096559.403868:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 204 00000100:00100000:2.0:1787096559.405239:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1787096559.405284:0:7414:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352847872 00000100:00100000:1.0:1787096559.405289:0:7414:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352847872 00000100:00100000:1.0:1787096559.405325:0:7414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 205 00000100:00100000:1.0:1787096559.405334:0:7414:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d6ea18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47c5a664-3f41-4887-ab67-ea7db94c9f90+8:35525:x1873906352847872:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:1.0:1787096559.405347:0:7414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096559.405358:0:7414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cf000/0x1b9fb40e15b44139 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc6d19 expref: -99 pid: 7414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096559.405415:0:7414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cf400/0x1b9fb40e15b44140 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096559.405425:0:7414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cf400/0x1b9fb40e15b44140 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096559.405434:0:7414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cf400/0x1b9fb40e15b44140 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096559.405453:0:7414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cfe00/0x1b9fb40e15b44147 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096559.405461:0:7414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cfe00/0x1b9fb40e15b44147 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096559.405467:0:7414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cfe00/0x1b9fb40e15b44147 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096559.405523:0:7414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cfc00/0x1b9fb40e15b4414e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096559.405528:0:7414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cfc00/0x1b9fb40e15b4414e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096559.405539:0:7414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cfc00/0x1b9fb40e15b4414e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787096559.405590:0:7414:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x12:0x0]: returning size 4096 00000004:00200000:1.0:1787096559.405593:0:7414:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:1.0:1787096559.405602:0:7414:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cfc00/0x1b9fb40e15b4414e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096559.405610:0:7414:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cf400/0x1b9fb40e15b44140 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096559.405614:0:7414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cf400/0x1b9fb40e15b44140 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096559.405620:0:7414:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cf400/0x1b9fb40e15b44140 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096559.405636:0:7414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cf400/0x1b9fb40e15b44140 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096559.405641:0:7414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d6e9cf400 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:1.0:1787096559.405645:0:7414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cf400/0x1b9fb40e15b44140 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096559.405652:0:7414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cf400/0x1b9fb40e15b44140 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096559.405668:0:7414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9c41286000) 00010000:00010000:1.0:1787096559.405670:0:7414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096559.405674:0:7414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cf400/0x1b9fb40e15b44140 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096559.405680:0:7414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cf400/0x1b9fb40e15b44140 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096559.405689:0:7414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cfe00/0x1b9fb40e15b44147 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096559.405693:0:7414:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cfe00/0x1b9fb40e15b44147 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096559.405696:0:7414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cfe00/0x1b9fb40e15b44147 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096559.405699:0:7414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d6e9cfe00 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:1.0:1787096559.405701:0:7414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cfe00/0x1b9fb40e15b44147 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096559.405711:0:7414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cfe00/0x1b9fb40e15b44147 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096559.405716:0:7414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2e9bf99 (ffff9c9d820d2100) 00010000:00010000:1.0:1787096559.405717:0:7414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096559.405719:0:7414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cfe00/0x1b9fb40e15b44147 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096559.405722:0:7414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cfe00/0x1b9fb40e15b44147 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096559.405743:0:7414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cf000/0x1b9fb40e15b44139 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6d19 expref: 10 pid: 7414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096559.405754:0:7414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cfc00/0x1b9fb40e15b4414e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6d19 expref: 9 pid: 7414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096559.405761:0:7414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff9c9d6b35ce00) 00010000:00010000:1.0:1787096559.405763:0:7414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787096559.405765:0:7414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d6e9cfc00, rc 0) 00000100:00100000:1.0:1787096559.405815:0:7414:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d6ea18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47c5a664-3f41-4887-ab67-ea7db94c9f90+9:35525:x1873906352847872:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 479us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096559.405824:0:7414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 205 00000100:00100000:1.0:1787096559.408118:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1787096559.408194:0:9995:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352848000 00000100:00100000:3.0:1787096559.408201:0:9995:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352848000 00000100:00100000:3.0:1787096559.408241:0:9995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 206 00000100:00100000:3.0:1787096559.408248:0:9995:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c41e6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47c5a664-3f41-4887-ab67-ea7db94c9f90+9:35525:x1873906352848000:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:3.0:1787096559.408264:0:9995:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787096559.408285:0:9995:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2000/0x1b9fb40e15b44155 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc6d20 expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096559.408321:0:9995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3400/0x1b9fb40e15b4415c lrc: 3/1,0 mode: --/PR res: [0x200000400:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096559.408332:0:9995:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3400/0x1b9fb40e15b4415c lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096559.408353:0:9995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3400/0x1b9fb40e15b4415c lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787096559.408386:0:9995:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000400:0x2:0x0]: returning size 4096 00000004:00200000:3.0:1787096559.408502:0:9995:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1787096559.408536:0:9995:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2000/0x1b9fb40e15b44155 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6d20 expref: 11 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096559.408551:0:9995:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3400/0x1b9fb40e15b4415c lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6d20 expref: 10 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096559.408560:0:9995:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x2:0x0].0x0 (ffff9c9d6b35c400) 00010000:00010000:3.0:1787096559.408563:0:9995:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787096559.408566:0:9995:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d6eac3400, rc 0) 00000100:00100000:3.0:1787096559.408616:0:9995:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c41e6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47c5a664-3f41-4887-ab67-ea7db94c9f90+10:35525:x1873906352848000:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 368us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096559.408623:0:9995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 206 00000100:00100000:3.0:1787096559.409737:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1787096559.409788:0:6480:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352848128 00000100:00100000:2.0:1787096559.409803:0:6480:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352848128 00000100:00100000:2.0:1787096559.409840:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 207 00000100:00100000:2.0:1787096559.409845:0:6480:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7fa99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47c5a664-3f41-4887-ab67-ea7db94c9f90+5:35525:x1873906352848128:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:2.0:1787096559.409859:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096559.409872:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4b600/0x1b9fb40e15b44163 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc6d27 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096559.409913:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4a800/0x1b9fb40e15b4416a lrc: 3/1,0 mode: --/PR res: [0x240000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096559.409926:0:6480:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9ce000/0x1b9fb40e15b44124 lrc: 2/0,0 mode: PW/PW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1b9fb40e15b4411d expref: 6 pid: 7723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096559.409934:0:6480:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4a800/0x1b9fb40e15b4416a lrc: 4/1,0 mode: --/PR res: [0x240000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096559.409973:0:6480:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9ce000/0x1b9fb40e15b44124 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x1b9fb40e15b4411d expref: 6 pid: 7723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096559.409988:0:6480:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d6e996d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6480:1873906360261760:0@lo:104: 00000100:00100000:2.0:1787096559.410030:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096559.410073:0:6480:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9c42ca4cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787096559.410137:0:6464:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787096559.410148:0:6464:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360261760 00000100:00100000:1.0:1787096559.410150:0:6464:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360261760 00000100:00100000:1.0:1787096559.410216:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787096559.410230:0:6464:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7dad1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6480:x1873906360261760:12345-0@lo:104: 00010000:00010000:1.0:1787096559.410241:0:6464:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9c9d7cceac00/0x1b9fb40e15b4411d lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x1b9fb40e15b44124 expref: -99 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096559.410301:0:6464:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787096559.410307:0:6464:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7dad1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6480:x1873906360261760:12345-0@lo:104: Request processed in 79us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096559.410313:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787096559.410366:0:6480:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d6e996d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6480:1873906360261760:0@lo:104: 00010000:00010000:0.0:1787096559.410389:0:7403:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787096559.410421:0:6480:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4a800/0x1b9fb40e15b4416a lrc: 3/1,0 mode: --/PR res: [0x240000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.410422:0:7403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9c9d7cceac00/0x1b9fb40e15b4411d lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x1b9fb40e15b44124 expref: -99 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.410441:0:7403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d7cceac00 already unused, calling callback (ffffffffc1953ee0) 00010000:00010000:0.0:1787096559.410446:0:7403:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9c9d7cceac00/0x1b9fb40e15b4411d lrc: 4/0,0 mode: PW/PW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x1b9fb40e15b44124 expref: -99 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787096559.410466:0:7403:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9c9d7cceac00/0x1b9fb40e15b4411d lrc: 4/0,0 mode: PW/PW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x1b9fb40e15b44124 expref: -99 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.410489:0:7403:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9c9d7cceac00/0x1b9fb40e15b4411d lrc: 2/0,0 mode: --/PW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x1b9fb40e15b44124 expref: -99 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.410495:0:7403:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787096559.410518:0:7403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9c9d7cceac00/0x1b9fb40e15b4411d lrc: 1/0,0 mode: --/PW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x1b9fb40e15b44124 expref: -99 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.410526:0:7403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9c9d7cceac00/0x1b9fb40e15b4411d lrc: 0/0,0 mode: --/PW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x1b9fb40e15b44124 expref: -99 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096559.410533:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d74859880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1873906360261888:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787096559.410546:0:7403:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787096559.410550:0:7403:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787096559.410552:0:7403:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787096559.410568:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096559.410826:0:6467:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360261888 00000100:00100000:0.0:1787096559.410830:0:6467:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360261888 00010000:00010000:0.0:1787096559.410847:0:6467:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9ce000/0x1b9fb40e15b44124 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x1b9fb40e15b4411d expref: 7 pid: 7723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096559.410872:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787096559.410879:0:6467:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7fa98e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+7:3628:x1873906360261888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787096559.410888:0:6467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:2.0:1787096559.412452:0:7392:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967328 is committed 00010000:00010000:0.0:1787096559.412544:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9ce000/0x1b9fb40e15b44124 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x1b9fb40e15b4411d expref: 6 pid: 7723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.412565:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x2:0x0].0x0 (ffff9c9d48c61a00) 00010000:00010000:0.0:1787096559.412577:0:6467:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4a800/0x1b9fb40e15b4416a lrc: 3/1,0 mode: --/PR res: [0x240000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.412586:0:6467:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4a800/0x1b9fb40e15b4416a lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6480 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.412593:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4a800/0x1b9fb40e15b4416a lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6480 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.412622:0:6467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787096559.412654:0:6480:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4a800/0x1b9fb40e15b4416a lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096559.412671:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4a800/0x1b9fb40e15b4416a lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096559.412673:0:6467:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7fa98e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1873906360261888:12345-0@lo:103:ldlm_bl.0 Request processed in 1794us (2104us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096559.412680:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000004:00200000:3.0:1787096559.412712:0:6480:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000401:0x2:0x0]: returning size 4096 00000100:00100000:1.0:1787096559.412712:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d74859880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1873906360261888:0@lo:103:ldlm_bl.0 00000004:00200000:3.0:1787096559.412718:0:6480:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1787096559.412761:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4b600/0x1b9fb40e15b44163 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6d27 expref: 7 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096559.412776:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4a800/0x1b9fb40e15b4416a lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6d27 expref: 6 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096559.412784:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x2:0x0].0x0 (ffff9c9d48c61a00) 00010000:00010000:3.0:1787096559.412787:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787096559.412789:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d7ca4a800, rc 0) 00000100:00100000:3.0:1787096559.412846:0:6480:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7fa99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47c5a664-3f41-4887-ab67-ea7db94c9f90+6:35525:x1873906352848128:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 3000us (3111us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096559.412853:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 207 00000100:00100000:2.0:1787096559.414218:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1787096559.414261:0:6481:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352848256 00000100:00100000:0.0:1787096559.414267:0:6481:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352848256 00000100:00100000:0.0:1787096559.414309:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 208 00000100:00100000:0.0:1787096559.414319:0:6481:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d6e994a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47c5a664-3f41-4887-ab67-ea7db94c9f90+6:35525:x1873906352848256:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:0.0:1787096559.414336:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787096559.414351:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ccebe00/0x1b9fb40e15b44171 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc6d2e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.414432:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ccea200/0x1b9fb40e15b44178 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.414444:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ccea200/0x1b9fb40e15b44178 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6481 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.414453:0:6481:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ccea200/0x1b9fb40e15b44178 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6481 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.415748:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7cceb400/0x1b9fb40e15b4417f lrc: 3/1,0 mode: --/PR res: [0x240000401:0x2:0x0].0x45ad699a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.415768:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7cceb400/0x1b9fb40e15b4417f lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x2:0x0].0x45ad699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6481 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.415777:0:6481:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7cceb400/0x1b9fb40e15b4417f lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x2:0x0].0x45ad699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6481 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.415838:0:6481:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ccea200/0x1b9fb40e15b44178 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6481 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.415846:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ccea200/0x1b9fb40e15b44178 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6481 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.415852:0:6481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ccea200/0x1b9fb40e15b44178 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6481 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.415858:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ccea200/0x1b9fb40e15b44178 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6481 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.415863:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d7ccea200 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:0.0:1787096559.415867:0:6481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ccea200/0x1b9fb40e15b44178 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6481 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.415874:0:6481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ccea200/0x1b9fb40e15b44178 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6481 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.415884:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x2:0x0].0x0 (ffff9c9d48c61a00) 00010000:00010000:0.0:1787096559.415887:0:6481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096559.415890:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ccea200/0x1b9fb40e15b44178 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6481 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.415896:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ccea200/0x1b9fb40e15b44178 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6481 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.415915:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7cceb400/0x1b9fb40e15b4417f lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x2:0x0].0x45ad699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6481 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.415920:0:6481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7cceb400/0x1b9fb40e15b4417f lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x2:0x0].0x45ad699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6481 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.415925:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7cceb400/0x1b9fb40e15b4417f lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x2:0x0].0x45ad699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6481 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.415930:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d7cceb400 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:0.0:1787096559.415932:0:6481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7cceb400/0x1b9fb40e15b4417f lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x2:0x0].0x45ad699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6481 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.415937:0:6481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7cceb400/0x1b9fb40e15b4417f lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x2:0x0].0x45ad699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6481 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.415943:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x2:0x0].0x45ad699a (ffff9c9d6b35c600) 00010000:00010000:0.0:1787096559.415945:0:6481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096559.415948:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7cceb400/0x1b9fb40e15b4417f lrc: 2/0,0 mode: --/PR res: [0x240000401:0x2:0x0].0x45ad699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6481 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.415953:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7cceb400/0x1b9fb40e15b4417f lrc: 0/0,0 mode: --/PR res: [0x240000401:0x2:0x0].0x45ad699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6481 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.415982:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ccebe00/0x1b9fb40e15b44171 lrc: 1/0,0 mode: --/CR res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6d2e expref: 7 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.415992:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x2:0x0].0x0 (ffff9c9d48c61a00) 00010000:00010000:0.0:1787096559.415994:0:6481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096559.416003:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ccebe00/0x1b9fb40e15b44171 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6d2e expref: 7 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.416012:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d7ccebe00, rc 0) 00000100:00100000:0.0:1787096559.416063:0:6481:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d6e994a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47c5a664-3f41-4887-ab67-ea7db94c9f90+6:35525:x1873906352848256:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 1745us (1846us total) trans 0 rc 301/301 00000100:00100000:0.0:1787096559.416070:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 208 00000100:00100000:1.0:1787096559.417731:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1787096559.417776:0:18819:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352848512 00000100:00100000:0.0:1787096559.417782:0:18819:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352848512 00000100:00100000:0.0:1787096559.417827:0:18819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 209 00000100:00100000:0.0:1787096559.417833:0:18819:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c41e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:47c5a664-3f41-4887-ab67-ea7db94c9f90+6:35525:x1873906352848512:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:0.0:1787096559.417847:0:18819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787096559.417849:0:18819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787096559.417861:0:18819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4a800/0x1b9fb40e15b4416a lrc: 0/0,0 mode: --/PR res: [0x240000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6d27 expref: 6 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.417871:0:18819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x2:0x0].0x0 (ffff9c9d48c61a00) 00010000:00010000:0.0:1787096559.417876:0:18819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787096559.417883:0:18819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7cceae00/0x1b9fb40e15b44186 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc6d35 expref: -99 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.417936:0:18819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ccebc00/0x1b9fb40e15b4418d lrc: 3/0,1 mode: --/CW res: [0x240000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.417943:0:18819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ccebc00/0x1b9fb40e15b4418d lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18819 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.417948:0:18819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ccebc00/0x1b9fb40e15b4418d lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18819 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.417963:0:18819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7cceaa00/0x1b9fb40e15b44194 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x2:0x0].0x45ad699a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.417967:0:18819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7cceaa00/0x1b9fb40e15b44194 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x2:0x0].0x45ad699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18819 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.417971:0:18819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7cceaa00/0x1b9fb40e15b44194 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x2:0x0].0x45ad699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18819 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096559.418069:0:18819:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d74859180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:18819:1873906360262016:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1787096559.418100:0:18819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096559.418128:0:18819:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9c41e4b780 going to sleep for 11 seconds 00000100:00100000:2.0:1787096559.418155:0:6485:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360262016 00000100:00100000:2.0:1787096559.418160:0:6485:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360262016 00000100:00100000:2.0:1787096559.418204:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1787096559.418211:0:6485:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d74859880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+12:18819:x1873906360262016:12345-0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1787096559.418292:0:6485:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d74859880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+12:18819:x1873906360262016:12345-0@lo:1000:mdt00_005.0 Request processed in 81us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096559.418300:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1787096559.418323:0:18819:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d74859180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:18819:1873906360262016:0@lo:1000:mdt00_005.0 00010000:00010000:0.0:1787096559.418638:0:18819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7cceb000/0x1b9fb40e15b4419b lrc: 3/1,0 mode: --/PR res: [0x240000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.418648:0:18819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7cceb000/0x1b9fb40e15b4419b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18819 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.418655:0:18819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7cceb000/0x1b9fb40e15b4419b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18819 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787096559.418665:0:18819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787096559.418686:0:18819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ccebc00/0x1b9fb40e15b4418d lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18819 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.418693:0:18819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ccebc00/0x1b9fb40e15b4418d lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18819 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.418696:0:18819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ccebc00/0x1b9fb40e15b4418d lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18819 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.418705:0:18819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ccebc00/0x1b9fb40e15b4418d lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18819 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.418709:0:18819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d7ccebc00 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:0.0:1787096559.418711:0:18819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ccebc00/0x1b9fb40e15b4418d lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18819 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.418715:0:18819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ccebc00/0x1b9fb40e15b4418d lrc: 5/0,0 mode: CW/CW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18819 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.418721:0:18819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x2:0x0].0x0 (ffff9c9d6b35c000) 00010000:00010000:0.0:1787096559.418723:0:18819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096559.418726:0:18819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ccebc00/0x1b9fb40e15b4418d lrc: 3/0,0 mode: --/CW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18819 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.418730:0:18819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ccebc00/0x1b9fb40e15b4418d lrc: 0/0,0 mode: --/CW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18819 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787096559.418743:0:18819:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000024fd3254 reply state 000000005f430ddd transno 4294967329 ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7cceaa00/0x1b9fb40e15b44194 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x2:0x0].0x45ad699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18819 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.418750:0:18819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7cceaa00/0x1b9fb40e15b44194 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x2:0x0].0x45ad699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18819 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.418754:0:18819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x2:0x0].0x45ad699a (ffff9c9d6b35c200) 00010000:00010000:0.0:1787096559.418755:0:18819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787096559.418757:0:18819:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787096559.418775:0:18819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7cceae00/0x1b9fb40e15b44186 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6d35 expref: 8 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.418786:0:18819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7cceb000/0x1b9fb40e15b4419b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6d35 expref: 7 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.418808:0:18819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7:0x0].0x0 (ffff9c9d6b35cc00) 00010000:00010000:0.0:1787096559.418810:0:18819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787096559.418814:0:18819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d7cceb000, rc 0) 00000100:00100000:0.0:1787096559.418848:0:18819:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c41e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:47c5a664-3f41-4887-ab67-ea7db94c9f90+8:35525:x1873906352848512:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 1015us (1118us total) trans 4294967329 rc 0/0 00000100:00100000:0.0:1787096559.418854:0:18819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 209 00000100:00100000:3.0:1787096559.420852:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1787096559.420896:0:6479:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352848768 00000100:00100000:0.0:1787096559.420903:0:6479:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352848768 00000100:00100000:0.0:1787096559.420938:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 210 00000100:00100000:0.0:1787096559.420945:0:6479:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7fa98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47c5a664-3f41-4887-ab67-ea7db94c9f90+8:35525:x1873906352848768:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:0.0:1787096559.420959:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787096559.420968:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7cceb200/0x1b9fb40e15b441a9 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc6d3c expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.421022:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ccea400/0x1b9fb40e15b441b0 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.421031:0:6479:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7cceb000/0x1b9fb40e15b4419b lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6d35 expref: 9 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.421037:0:6479:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ccea400/0x1b9fb40e15b441b0 lrc: 4/0,1 mode: --/EX res: [0x240000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.421054:0:6479:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7cceb000/0x1b9fb40e15b4419b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6d35 expref: 9 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.421062:0:6479:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7cceb000/0x1b9fb40e15b4419b lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6d35 expref: 9 pid: 18819 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096559.421079:0:6479:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d74859180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6479:1873906360262144:192.168.203.27@tcp:104: 00000100:00100000:0.0:1787096559.421134:0:6479:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9c41e4bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787096559.422211:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1787096559.422260:0:8378:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352848896 00000100:00100000:1.0:1787096559.422265:0:8378:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352848896 00010000:00010000:1.0:1787096559.422286:0:8378:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7cceb000/0x1b9fb40e15b4419b lrc: 5/0,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6d35 expref: 10 pid: 18819 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096559.422315:0:8378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 78 00000100:00100000:1.0:1787096559.422322:0:8378:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42d70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:47c5a664-3f41-4887-ab67-ea7db94c9f90+10:2402:x1873906352848896:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787096559.422331:0:8378:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787096559.422336:0:8378:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7cceb000/0x1b9fb40e15b4419b lrc: 5/0,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6d35 expref: 10 pid: 18819 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096559.422348:0:8378:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7cceb000/0x1b9fb40e15b4419b lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6d35 expref: 10 pid: 18819 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096559.422363:0:8378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7:0x0].0x0 (ffff9c9d6b35cc00) 00010000:00010000:1.0:1787096559.422367:0:8378:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ccea400/0x1b9fb40e15b441b0 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096559.422383:0:8378:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ccea400/0x1b9fb40e15b441b0 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6479 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096559.422389:0:8378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ccea400/0x1b9fb40e15b441b0 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6479 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096559.422427:0:8378:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787096559.422457:0:8378:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42d70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:47c5a664-3f41-4887-ab67-ea7db94c9f90+10:2402:x1873906352848896:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 134us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096559.422464:0:8378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 78 00010000:00010000:0.0:1787096559.422866:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7cceb000/0x1b9fb40e15b4419b lrc: 0/0,0 mode: --/PR res: [0x240000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6d35 expref: 9 pid: 18819 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096559.422881:0:6479:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d74859180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6479:1873906360262144:192.168.203.27@tcp:104: 00010000:00010000:0.0:1787096559.422894:0:6479:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ccea400/0x1b9fb40e15b441b0 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.422903:0:6479:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ccea400/0x1b9fb40e15b441b0 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.422909:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ccea400/0x1b9fb40e15b441b0 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787096559.422923:0:6479:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787096559.423016:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ccea400/0x1b9fb40e15b441b0 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.423023:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ccea400/0x1b9fb40e15b441b0 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.423030:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ccea400/0x1b9fb40e15b441b0 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.423035:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d7ccea400 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:0.0:1787096559.423038:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ccea400/0x1b9fb40e15b441b0 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.423055:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ccea400/0x1b9fb40e15b441b0 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.423063:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7:0x0].0x0 (ffff9c9d6b35cc00) 00010000:00010000:0.0:1787096559.423066:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787096559.423069:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ccea400/0x1b9fb40e15b441b0 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.423075:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ccea400/0x1b9fb40e15b441b0 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.423099:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7cceb200/0x1b9fb40e15b441a9 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6d3c expref: 8 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.423107:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7:0x0].0x0 (ffff9c9d6b35cc00) 00010000:00010000:0.0:1787096559.423109:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787096559.423113:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7cceb200/0x1b9fb40e15b441a9 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6d3c expref: 8 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096559.423125:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d7cceb200, rc 0) 00000100:00100000:0.0:1787096559.423153:0:6479:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7fa98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47c5a664-3f41-4887-ab67-ea7db94c9f90+7:35525:x1873906352848768:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 2208us (2302us total) trans 0 rc 301/301 00000100:00100000:0.0:1787096559.423160:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 210 00000100:00100000:3.0:1787096559.424155:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1787096559.424206:0:13479:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352849152 00000100:00100000:2.0:1787096559.424212:0:13479:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352849152 00000100:00100000:2.0:1787096559.424248:0:13479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 36 00000100:00100000:2.0:1787096559.424255:0:13479:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42d72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:47c5a664-3f41-4887-ab67-ea7db94c9f90+7:35525:x1873906352849152:12345-192.168.203.27@tcp:35:lfs.0 00000100:00100000:2.0:1787096559.424387:0:13479:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42d72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:47c5a664-3f41-4887-ab67-ea7db94c9f90+8:35525:x1873906352849152:12345-192.168.203.27@tcp:35:lfs.0 Request processed in 132us (237us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1787096559.424417:0:13479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 36 00000001:02000400:2.0:1787096559.912706:0:22559:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-ec test_24a: @@@@@@ FAIL: setstripe failed 00010000:00010000:0.0:1787096560.334509:0:6468:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787096560.334541:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787096560.334566:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d6e994000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1873906360262272:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787096560.334639:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096560.334683:0:6484:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360262272 00000100:00100000:3.0:1787096560.334694:0:6484:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360262272 00000100:00100000:3.0:1787096560.334760:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1787096560.334769:0:6484:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d74859180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+12:3626:x1873906360262272:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787096560.334822:0:6484:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446113280 avail 1299873792 00000100:00100000:3.0:1787096560.334869:0:6484:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d74859180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+12:3626:x1873906360262272:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096560.334902:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1787096560.334915:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d6e994000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1873906360262272:0@lo:41:osp-pre-0-1.0 Debug log: 1439 lines, 1439 kept, 0 dropped, 0 bad.