00010000:00010000:2.0F:1787096583.439218:0:10297:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0F:1787096584.071803:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0F:1787096584.071871:0:6490:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345501952 00000100:00100000:0.0:1787096584.071888:0:6490:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345501952 00000100:00080000:1.0:1787096584.071938:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787096584.071973:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 174 00000100:00100000:0.0:1787096584.071986:0:6490:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742d05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70e19547-606a-4706-b016-3476e377d7df+23:34759:x1873906345501952:12345-192.168.201.40@tcp:101:rm.0 00010000:00010000:0.0:1787096584.072007:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787096584.072034:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9618821ee000/0xa979d75fc166bec8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2ded7f867b203a expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.072102:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9618821ee200/0xa979d75fc166becf lrc: 3/1,0 mode: --/PR res: [0x240000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.072116:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9618821ee200/0xa979d75fc166becf lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.072125:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9618821ee200/0xa979d75fc166becf lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787096584.072205:0:6490:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1787096584.072209:0:6490:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:0.0:1787096584.072223:0:6490:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9618821ee200/0xa979d75fc166becf lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.072243:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9618821ee000/0xa979d75fc166bec8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b203a expref: 25 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.072259:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9618821ee200/0xa979d75fc166becf lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b203a expref: 24 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.072265:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3:0x0].0x0 (ffff961741937200) 00010000:00010000:0.0:1787096584.072267:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787096584.072270:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9618821ee200, rc 0) 00000100:00100000:0.0:1787096584.072321:0:6490:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742d05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70e19547-606a-4706-b016-3476e377d7df+24:34759:x1873906345501952:12345-192.168.201.40@tcp:101:rm.0 Request processed in 340us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096584.072327:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 174 00000100:00100000:1.0:1787096584.075089:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1787096584.075182:0:6489:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345502080 00000100:00100000:0.0:1787096584.075190:0:6489:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345502080 00000100:00100000:0.0:1787096584.075273:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 175 00000100:00100000:0.0:1787096584.075283:0:6489:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96187552a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70e19547-606a-4706-b016-3476e377d7df+24:34759:x1873906345502080:12345-192.168.201.40@tcp:101:rm.0 00010000:00010000:0.0:1787096584.075299:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787096584.075313:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9618821ef400/0xa979d75fc166bed6 lrc: 2/0,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2ded7f867b2041 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.075359:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff96174340f600/0xa979d75fc166bedd lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.075372:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96174340f600/0xa979d75fc166bedd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.075381:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96174340f600/0xa979d75fc166bedd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787096584.075412:0:6489:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000400:0x5:0x0]: returning size 4096 00000004:00200000:0.0:1787096584.075416:0:6489:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1787096584.075457:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9618821ef400/0xa979d75fc166bed6 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2041 expref: 26 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.075474:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff96174340f600/0xa979d75fc166bedd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2041 expref: 25 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.075483:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0x0 (ffff961741937400) 00010000:00010000:0.0:1787096584.075494:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787096584.075499:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96174340f600, rc 0) 00000100:00100000:0.0:1787096584.075550:0:6489:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96187552a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70e19547-606a-4706-b016-3476e377d7df+25:34759:x1873906345502080:12345-192.168.201.40@tcp:101:rm.0 Request processed in 269us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096584.075559:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 175 00000100:00100000:0.0:1787096584.079436:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1787096584.079612:0:6488:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345502336 00000100:00100000:2.0:1787096584.079622:0:6488:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345502336 00000100:00100000:2.0:1787096584.079683:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 176 00000100:00100000:2.0:1787096584.079696:0:6488:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96187c9e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70e19547-606a-4706-b016-3476e377d7df+25:34759:x1873906345502336:12345-192.168.201.40@tcp:101:rm.0 00010000:00010000:2.0:1787096584.079716:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096584.079737:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4a600/0xa979d75fc166bee4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2ded7f867b2048 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787096584.079896:0:6488:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1787096584.080000:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4a600/0xa979d75fc166bee4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2048 expref: 27 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.080016:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961742a26b00) 00010000:00010000:2.0:1787096584.080019:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787096584.080026:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4a600/0xa979d75fc166bee4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2048 expref: 27 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.080042:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961845b4a600, rc 0) 00000100:00100000:2.0:1787096584.080107:0:6488:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96187c9e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70e19547-606a-4706-b016-3476e377d7df+26:34759:x1873906345502336:12345-192.168.201.40@tcp:101:rm.0 Request processed in 414us (677us total) trans 4294967311 rc 301/301 00000100:00100000:2.0:1787096584.080116:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 176 00010000:00010000:1.0:1787096584.082127:0:7400:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff96174340ec00/0xa979d75fc166bd9b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xa979d75fc166bda2 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787096584.082141:0:7400:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff96174340ec00/0xa979d75fc166bd9b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xa979d75fc166bda2 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.082157:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9618429d3000/0xa979d75fc166bc52 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.082168:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9618429d3000/0xa979d75fc166bc52 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096584.082175:0:7400:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff96174340ec00/0xa979d75fc166bd9b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xa979d75fc166bda2 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.082176:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9618429d3000/0xa979d75fc166bc52 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096584.082192:0:7400:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787096584.082205:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618429d3000 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:2.0:1787096584.082209:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9618429d3000/0xa979d75fc166bc52 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.082216:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9618429d3000/0xa979d75fc166bc52 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096584.082218:0:7400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff96174340ec00/0xa979d75fc166bd9b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xa979d75fc166bda2 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.082232:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff9618472ca100) 00000001:00080000:1.0:1787096584.082235:0:7400:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967311 is committed 00010000:00010000:2.0:1787096584.082236:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096584.082241:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9618429d3000/0xa979d75fc166bc52 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.082247:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9618429d3000/0xa979d75fc166bc52 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787096584.082251:0:7400:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff961846d0c240 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1787096584.082256:0:7400:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff961742ebe700 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff961846d0c900 00000020:00080000:1.0:1787096584.082260:0:7400:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].3 00000020:00080000:1.0:1787096584.082262:0:7400:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff961742ebec00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff961742c59e00 00010000:00010000:2.0:1787096584.082263:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9618429d3800/0xa979d75fc166bc59 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787096584.082268:0:7400:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].3 00000020:00080000:1.0:1787096584.082278:0:7400:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff961741ec33c0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1787096584.082286:0:7400:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff961845354e00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff961741ec3780 00010000:00010000:2.0:1787096584.082291:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9618429d3800/0xa979d75fc166bc59 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787096584.082292:0:7400:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].2 00000020:00080000:1.0:1787096584.082296:0:7400:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff961845354000 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff961742c58400 00000020:00080000:1.0:1787096584.082303:0:7400:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].2 00010000:00010000:2.0:1787096584.082306:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9618429d3800/0xa979d75fc166bc59 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.082311:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618429d3800 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:2.0:1787096584.082314:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9618429d3800/0xa979d75fc166bc59 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.082320:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9618429d3800/0xa979d75fc166bc59 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787096584.082320:0:7400:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9618754e1a80 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1787096584.082325:0:7400:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff961845354500 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9618754e16c0 00000020:00080000:1.0:1787096584.082333:0:7400:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].1 00000020:00080000:1.0:1787096584.082335:0:7400:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff961845354600 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff961742e9cc00 00000020:00080000:1.0:1787096584.082336:0:7400:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].1 00000100:00100000:1.0:1787096584.082346:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1787096584.082355:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x2:0x0].0x0 (ffff9618472ca500) 00010000:00010000:2.0:1787096584.082359:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787096584.082363:0:3634:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742e5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1873906353972096:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:2.0:1787096584.082372:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9618429d3800/0xa979d75fc166bc59 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.082379:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9618429d3800/0xa979d75fc166bc59 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.082396:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff96185b1d6800/0xa979d75fc166bcf3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x2:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.082403:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff96185b1d6800/0xa979d75fc166bcf3 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x2:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.082409:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff96185b1d6800/0xa979d75fc166bcf3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x2:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096584.082411:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787096584.082419:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96185b1d6800 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:2.0:1787096584.082422:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96185b1d6800/0xa979d75fc166bcf3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x2:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.082429:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96185b1d6800/0xa979d75fc166bcf3 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x2:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.082461:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x2:0x0].0x7b711ae6 (ffff9618472cad00) 00010000:00010000:2.0:1787096584.082464:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096584.082467:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff96185b1d6800/0xa979d75fc166bcf3 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x2:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.082474:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96185b1d6800/0xa979d75fc166bcf3 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x2:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.082498:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff96174340f000/0xa979d75fc166bd78 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x2:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.082504:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff96174340f000/0xa979d75fc166bd78 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x2:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.082510:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff96174340f000/0xa979d75fc166bd78 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x2:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.082515:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96174340f000 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:2.0:1787096584.082518:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96174340f000/0xa979d75fc166bd78 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x2:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.082524:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96174340f000/0xa979d75fc166bd78 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x2:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.082532:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x2:0x0].0x7b711ae6 (ffff9618472cad00) 00010000:00010000:2.0:1787096584.082535:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096584.082538:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff96174340f000/0xa979d75fc166bd78 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x2:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.082544:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96174340f000/0xa979d75fc166bd78 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x2:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.082561:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff96174340ea00/0xa979d75fc166be12 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.082568:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff96174340ea00/0xa979d75fc166be12 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.082574:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff96174340ea00/0xa979d75fc166be12 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787096584.083066:0:7425:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 3 committed batchid 0 00000020:00080000:0.0:1787096584.083225:0:7425:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000100:00100000:0.0:1787096584.083240:0:7412:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353972096 00000100:00100000:0.0:1787096584.083248:0:7412:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353972096 00000100:00100000:0.0:1787096584.083313:0:7412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787096584.083324:0:7412:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742db0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+7:3634:x1873906353972096:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1787096584.083336:0:7412:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787096584.083352:0:7412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4a000/0xa979d75fc166bda2 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xa979d75fc166bd9b expref: 7 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.083367:0:7412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa5d0027 (ffff961742a27d00) 00010000:00010000:0.0:1787096584.083376:0:7412:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787096584.083426:0:7412:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742db0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+6:3634:x1873906353972096:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 105us (1014us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096584.083435:0:7412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787096584.083530:0:3634:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742e5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1873906353972096:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:2.0:1787096584.083632:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96174340ea00 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:2.0:1787096584.083638:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96174340ea00/0xa979d75fc166be12 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.083646:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96174340ea00/0xa979d75fc166be12 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.083655:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3:0x0].0x0 (ffff961741937200) 00010000:00010000:2.0:1787096584.083657:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096584.083661:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff96174340ea00/0xa979d75fc166be12 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.083667:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96174340ea00/0xa979d75fc166be12 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.083677:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e600/0xa979d75fc166be19 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.083683:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e600/0xa979d75fc166be19 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.083688:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e600/0xa979d75fc166be19 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.083694:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96174340e600 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:2.0:1787096584.083697:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e600/0xa979d75fc166be19 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.083703:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e600/0xa979d75fc166be19 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.083721:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0x0 (ffff961741937400) 00010000:00010000:2.0:1787096584.083723:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096584.083727:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e600/0xa979d75fc166be19 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.083732:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e600/0xa979d75fc166be19 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.083744:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff96174340fa00/0xa979d75fc166bea5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x5:0x0].0xae2548a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.083751:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff96174340fa00/0xa979d75fc166bea5 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x5:0x0].0xae2548a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.083757:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff96174340fa00/0xa979d75fc166bea5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x5:0x0].0xae2548a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.083762:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96174340fa00 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:2.0:1787096584.083765:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96174340fa00/0xa979d75fc166bea5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x5:0x0].0xae2548a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.083770:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96174340fa00/0xa979d75fc166bea5 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x5:0x0].0xae2548a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.083778:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0xae2548a7 (ffff961741937e00) 00010000:00010000:2.0:1787096584.083780:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096584.083783:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff96174340fa00/0xa979d75fc166bea5 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x5:0x0].0xae2548a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.083788:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96174340fa00/0xa979d75fc166bea5 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x5:0x0].0xae2548a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096584.085194:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1787096584.085393:0:6492:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345502464 00000100:00100000:2.0:1787096584.085400:0:6492:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345502464 00000100:00100000:2.0:1787096584.085453:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 27 00000100:00100000:2.0:1787096584.085464:0:6492:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96185818e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70e19547-606a-4706-b016-3476e377d7df+8:34759:x1873906345502464:12345-192.168.201.40@tcp:37:rm.0 00000100:00100000:2.0:1787096584.092633:0:6492:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96185818e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70e19547-606a-4706-b016-3476e377d7df+8:34759:x1873906345502464:12345-192.168.201.40@tcp:37:rm.0 Request processed in 7164us (7434us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096584.092644:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 27 00000100:00100000:1.0:1787096584.096322:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1787096584.096391:0:6491:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345502592 00000100:00100000:2.0:1787096584.096401:0:6491:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345502592 00000100:00100000:2.0:1787096584.096489:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 28 00000100:00100000:2.0:1787096584.096499:0:6491:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742db3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70e19547-606a-4706-b016-3476e377d7df+8:34759:x1873906345502592:12345-192.168.201.40@tcp:37:rm.0 00000100:00080000:1.0:1787096584.097290:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787096584.099093:0:6491:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742db3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70e19547-606a-4706-b016-3476e377d7df+8:34759:x1873906345502592:12345-192.168.201.40@tcp:37:rm.0 Request processed in 2591us (2771us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096584.099105:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 28 00000100:00100000:2.0:1787096584.104693:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0F:1787096584.104907:0:6492:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345502848 00000100:00100000:3.0:1787096584.104923:0:6492:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345502848 00000100:00100000:3.0:1787096584.105016:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 29 00000100:00100000:3.0:1787096584.105028:0:6492:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961850227b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70e19547-606a-4706-b016-3476e377d7df+8:34759:x1873906345502848:12345-192.168.201.40@tcp:35:rm.0 00000100:00100000:3.0:1787096584.105248:0:6492:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961850227b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70e19547-606a-4706-b016-3476e377d7df+9:34759:x1873906345502848:12345-192.168.201.40@tcp:35:rm.0 Request processed in 221us (562us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1787096584.105256:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 29 00000100:00100000:0.0:1787096584.108045:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1787096584.108107:0:6490:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345503104 00000100:00100000:2.0:1787096584.108116:0:6490:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345503104 00000100:00100000:2.0:1787096584.108168:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 177 00000100:00100000:2.0:1787096584.108178:0:6490:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96187c9e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70e19547-606a-4706-b016-3476e377d7df+9:34759:x1873906345503104:12345-192.168.201.40@tcp:101:rm.0 00010000:00010000:2.0:1787096584.108199:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096584.108217:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4b600/0xa979d75fc166bef2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2ded7f867b204f expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.108348:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4b800/0xa979d75fc166bef9 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.108372:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4b800/0xa979d75fc166bef9 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.108383:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4b800/0xa979d75fc166bef9 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787096584.108394:0:6490:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1787096584.108562:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4b600/0xa979d75fc166bef2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b204f expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.108580:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4b800/0xa979d75fc166bef9 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b204f expref: 11 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.108589:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3:0x0].0x0 (ffff961741937200) 00010000:00010000:2.0:1787096584.108591:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787096584.108595:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961845b4b800, rc 0) 00000100:00100000:2.0:1787096584.108652:0:6490:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96187c9e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70e19547-606a-4706-b016-3476e377d7df+11:34759:x1873906345503104:12345-192.168.201.40@tcp:101:rm.0 Request processed in 476us (611us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1787096584.108710:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 177 00000100:00100000:2.0:1787096584.115158:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1787096584.115207:0:6489:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345503232 00000100:00100000:0.0:1787096584.115217:0:6489:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345503232 00000100:00100000:0.0:1787096584.115282:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 178 00000100:00100000:0.0:1787096584.115293:0:6489:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96187bb2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70e19547-606a-4706-b016-3476e377d7df+8:34759:x1873906345503232:12345-192.168.201.40@tcp:41:rm.0 00000004:00000024:0.0:1787096584.115341:0:6489:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 7847059456 avail 7384014848 00000100:00100000:0.0:1787096584.115418:0:6489:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96187bb2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70e19547-606a-4706-b016-3476e377d7df+8:34759:x1873906345503232:12345-192.168.201.40@tcp:41:rm.0 Request processed in 127us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096584.115425:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 178 00000100:00100000:2.0:1787096584.117956:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1787096584.117982:0:6488:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345503360 00000100:00100000:2.0:1787096584.117989:0:6488:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345503360 00000100:00100000:2.0:1787096584.118026:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 179 00000100:00100000:2.0:1787096584.118035:0:6488:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96187bbbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70e19547-606a-4706-b016-3476e377d7df+11:34759:x1873906345503360:12345-192.168.201.40@tcp:101:rm.0 00010000:00010000:2.0:1787096584.118107:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096584.118126:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4b600/0xa979d75fc166bf07 lrc: 2/0,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2ded7f867b2056 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.118190:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4a600/0xa979d75fc166bf0e lrc: 3/1,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.118204:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4a600/0xa979d75fc166bf0e lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.118213:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4a600/0xa979d75fc166bf0e lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.118587:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4a000/0xa979d75fc166bf15 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0xae2548a7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.118596:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4a000/0xa979d75fc166bf15 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0xae2548a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.118603:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4a000/0xa979d75fc166bf15 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0xae2548a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.118667:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4a800/0xa979d75fc166bf1c lrc: 3/1,0 mode: --/PR res: [0x240000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.118675:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4a800/0xa979d75fc166bf1c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.118681:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4a800/0xa979d75fc166bf1c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787096584.118718:0:6488:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787096584.118721:0:6488:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787096584.118737:0:6488:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4a800/0xa979d75fc166bf1c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.118756:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4a800/0xa979d75fc166bf1c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.118764:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4a600/0xa979d75fc166bf0e lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.118770:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4a600/0xa979d75fc166bf0e lrc: 2/0,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.118776:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4a600/0xa979d75fc166bf0e lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.118781:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961845b4a600 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:2.0:1787096584.118785:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4a600/0xa979d75fc166bf0e lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.118791:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4a600/0xa979d75fc166bf0e lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.118802:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0x0 (ffff961741937400) 00010000:00010000:2.0:1787096584.118804:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096584.118808:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4a600/0xa979d75fc166bf0e lrc: 2/0,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.118814:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4a600/0xa979d75fc166bf0e lrc: 0/0,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.118824:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4a000/0xa979d75fc166bf15 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0xae2548a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.118830:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4a000/0xa979d75fc166bf15 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0xae2548a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.118853:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4a000/0xa979d75fc166bf15 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0xae2548a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.118858:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961845b4a000 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:2.0:1787096584.118861:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4a000/0xa979d75fc166bf15 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0xae2548a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.118867:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4a000/0xa979d75fc166bf15 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0xae2548a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.118875:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0xae2548a7 (ffff961742a26b00) 00010000:00010000:2.0:1787096584.118877:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096584.118880:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4a000/0xa979d75fc166bf15 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0xae2548a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.118885:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4a000/0xa979d75fc166bf15 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0xae2548a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.118913:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4b600/0xa979d75fc166bf07 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2056 expref: 13 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.118926:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4a800/0xa979d75fc166bf1c lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2056 expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.118932:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x4:0x0].0x0 (ffff961742a26500) 00010000:00010000:2.0:1787096584.118934:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787096584.118937:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961845b4a800, rc 0) 00000100:00100000:2.0:1787096584.118981:0:6488:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96187bbbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70e19547-606a-4706-b016-3476e377d7df+12:34759:x1873906345503360:12345-192.168.201.40@tcp:101:rm.0 Request processed in 947us (1029us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096584.118996:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 179 00000100:00100000:3.0:1787096584.122313:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1787096584.122421:0:6490:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345503616 00000100:00100000:0.0:1787096584.122430:0:6490:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345503616 00000100:00100000:0.0:1787096584.122503:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 180 00000100:00100000:0.0:1787096584.122512:0:6490:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742fd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70e19547-606a-4706-b016-3476e377d7df+12:34759:x1873906345503616:12345-192.168.201.40@tcp:36:rm.0 00010000:00010000:0.0:1787096584.122558:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1787096584.122577:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4a800/0xa979d75fc166bf1c lrc: 0/0,0 mode: --/PR res: [0x240000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2056 expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.122594:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x4:0x0].0x0 (ffff961742a26500) 00010000:00010000:0.0:1787096584.122607:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96174340f600/0xa979d75fc166bedd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2041 expref: 11 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.122617:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0x0 (ffff961741937400) 00010000:00010000:0.0:1787096584.122624:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787096584.122641:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff96174340f400/0xa979d75fc166bf23 lrc: 3/0,1 mode: --/CW res: [0x240000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.122654:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96174340f400/0xa979d75fc166bf23 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.122663:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96174340f400/0xa979d75fc166bf23 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.122673:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e200/0xa979d75fc166bf2a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0xae2548a7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.122680:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e200/0xa979d75fc166bf2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0xae2548a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.122693:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e200/0xa979d75fc166bf2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0xae2548a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.122759:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff96174340f800/0xa979d75fc166bf31 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.122767:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96174340f800/0xa979d75fc166bf31 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.122774:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96174340f800/0xa979d75fc166bf31 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.122960:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e400/0xa979d75fc166bf38 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.122970:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e400/0xa979d75fc166bf38 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.122977:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e400/0xa979d75fc166bf38 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.122985:0:6490:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e400/0xa979d75fc166bf38 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.122991:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e400/0xa979d75fc166bf38 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.122997:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e400/0xa979d75fc166bf38 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.123017:0:6490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787096584.123032:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff96174340f800/0xa979d75fc166bf31 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.123043:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff96174340f800/0xa979d75fc166bf31 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.123050:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff96174340f800/0xa979d75fc166bf31 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.123055:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96174340f800 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:0.0:1787096584.123059:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96174340f800/0xa979d75fc166bf31 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.123066:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96174340f800/0xa979d75fc166bf31 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.123075:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x4:0x0].0x0 (ffff961741932400) 00010000:00010000:0.0:1787096584.123078:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787096584.123082:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff96174340f800/0xa979d75fc166bf31 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.123087:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96174340f800/0xa979d75fc166bf31 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.123101:0:6490:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff96174340f400/0xa979d75fc166bf23 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.123107:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff96174340f400/0xa979d75fc166bf23 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.123112:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff96174340f400/0xa979d75fc166bf23 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.123118:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff96174340f400/0xa979d75fc166bf23 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.123128:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96174340f400 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:0.0:1787096584.123131:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96174340f400/0xa979d75fc166bf23 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.123148:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96174340f400/0xa979d75fc166bf23 lrc: 5/0,0 mode: CW/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.123157:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0x0 (ffff961741932200) 00010000:00010000:0.0:1787096584.123159:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096584.123162:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff96174340f400/0xa979d75fc166bf23 lrc: 3/0,0 mode: --/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.123168:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96174340f400/0xa979d75fc166bf23 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787096584.123182:0:6490:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000f5014957 reply state 00000000b18e4b8f transno 4294967314 ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e200/0xa979d75fc166bf2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0xae2548a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.123192:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e200/0xa979d75fc166bf2a lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x5:0x0].0xae2548a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.123198:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0xae2548a7 (ffff961741932300) 00010000:00010000:0.0:1787096584.123200:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787096584.123203:0:6490:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787096584.123261:0:6490:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742fd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70e19547-606a-4706-b016-3476e377d7df+12:34759:x1873906345503616:12345-192.168.201.40@tcp:36:rm.0 Request processed in 749us (955us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1787096584.123268:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 180 00010000:00010000:3.0:1787096584.123409:0:6477:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787096584.123415:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e400/0xa979d75fc166bf38 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096584.123422:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96174340e400 already unused, calling callback (ffffffffc0bda6f0) 00010000:00010000:3.0:1787096584.123425:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e400/0xa979d75fc166bf38 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096584.123487:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e400/0xa979d75fc166bf38 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096584.123498:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x4:0x0].0x0 (ffff961741932400) 00010000:00010000:3.0:1787096584.123501:0:6477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787096584.123504:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e400/0xa979d75fc166bf38 lrc: 1/0,0 mode: --/PW res: [0x240000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096584.123510:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e400/0xa979d75fc166bf38 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096584.123523:0:6477:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787096584.123525:0:6477:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787096584.123527:0:6477:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787096584.126297:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1787096584.126336:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1787096584.126378:0:8380:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345503744 00000100:00100000:3.0:1787096584.126393:0:8380:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345503744 00000100:00100000:1.0:1787096584.126394:0:6491:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345504000 00000100:00100000:1.0:1787096584.126400:0:6491:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345504000 00000100:00100000:3.0:1787096584.126469:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10 00000100:00100000:1.0:1787096584.126473:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 30 00000100:00100000:3.0:1787096584.126482:0:8380:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96187c9e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:70e19547-606a-4706-b016-3476e377d7df+8:2401:x1873906345503744:12345-192.168.201.40@tcp:103:rm.0 00000100:00100000:1.0:1787096584.126485:0:6491:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96187c9e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70e19547-606a-4706-b016-3476e377d7df+12:34759:x1873906345504000:12345-192.168.201.40@tcp:35:rm.0 00010000:00010000:3.0:1787096584.126501:0:8380:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787096584.126521:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4aa00/0xa979d75fc166be51 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2009 expref: 8 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096584.126538:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3:0x0].0x0 (ffff961742a26600) 00010000:00010000:3.0:1787096584.126548:0:8380:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787096584.126593:0:8380:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96187c9e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:70e19547-606a-4706-b016-3476e377d7df+7:2401:x1873906345503744:12345-192.168.201.40@tcp:103:rm.0 Request processed in 115us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096584.126600:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10 00000100:00100000:1.0:1787096584.126636:0:6491:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96187c9e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70e19547-606a-4706-b016-3476e377d7df+13:34759:x1873906345504000:12345-192.168.201.40@tcp:35:rm.0 Request processed in 154us (345us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1787096584.126644:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 30 00000100:00100000:2.0:1787096584.129555:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1787096584.129610:0:8109:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345504256 00000100:00100000:1.0:1787096584.129616:0:8109:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345504256 00000100:00100000:1.0:1787096584.129651:0:8109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 181 00000100:00100000:1.0:1787096584.129657:0:8109:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961875503100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70e19547-606a-4706-b016-3476e377d7df+13:34759:x1873906345504256:12345-192.168.201.40@tcp:36:rm.0 00010000:00010000:1.0:1787096584.129694:0:8109:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787096584.129709:0:8109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4b800/0xa979d75fc166bef9 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b204f expref: 13 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096584.129723:0:8109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9618821ee200/0xa979d75fc166becf lrc: 0/0,0 mode: --/PR res: [0x240000402:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b203a expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096584.129738:0:8109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e800/0xa979d75fc166be5f lrc: 0/0,0 mode: --/PR res: [0x240000402:0x3:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2010 expref: 11 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096584.129745:0:8109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3:0x0].0x0 (ffff961741937200) 00010000:00010000:1.0:1787096584.129751:0:8109:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787096584.129792:0:8109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff96186ddf5c00/0xa979d75fc166bf3f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096584.129798:0:8109:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff96186ddf5c00/0xa979d75fc166bf3f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096584.129805:0:8109:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff96186ddf5c00/0xa979d75fc166bf3f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096584.129823:0:8109:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742db0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8109:1873906353972224:0@lo:101:mdt00_003.0 00000100:00100000:1.0:1787096584.129875:0:8109:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096584.131376:0:8109:0:(client.c:2692:ptlrpc_set_wait()) set ffff96187cad6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787096584.133641:0:7418:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353972224 00000100:00100000:3.0:1787096584.133650:0:7418:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353972224 00000100:00100000:2.0:1787096584.133938:0:7418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1787096584.133948:0:7418:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742db0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:8109:x1873906353972224:12345-0@lo:101:mdt00_003.0 00010000:00010000:2.0:1787096584.133967:0:7418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096584.133987:0:7418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4b600/0xa979d75fc166bf46 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa979d75fc166bf3f expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.134017:0:7418:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96174340fe00/0xa979d75fc166be35 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2002 expref: 6 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.134028:0:7418:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4b600/0xa979d75fc166bf46 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xa979d75fc166bf3f expref: 7 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.134060:0:7418:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96174340fe00/0xa979d75fc166be35 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2002 expref: 6 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.134074:0:7418:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96174340fe00/0xa979d75fc166be35 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2002 expref: 6 pid: 6489 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096584.134089:0:7418:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961875503480 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:7418:1873906353972352:192.168.201.40@tcp:104: 00000100:00100000:2.0:1787096584.134163:0:7418:0:(client.c:2692:ptlrpc_set_wait()) set ffff961742a35780 going to sleep for 11 seconds 00000100:00100000:2.0:1787096584.137576:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1787096584.137629:0:7418:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961875503480 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:7418:1873906353972352:192.168.201.40@tcp:104: 00010000:00010000:2.0:1787096584.137660:0:7418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4b600/0xa979d75fc166bf46 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xa979d75fc166bf3f expref: 7 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.137685:0:7418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9618472ca600) 00010000:00010000:2.0:1787096584.137689:0:7418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096584.137693:0:7418:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4b600/0xa979d75fc166bf46 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xa979d75fc166bf3f expref: 7 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.137704:0:7418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961845b4b600, rc 0) 00000100:00100000:2.0:1787096584.137755:0:7418:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742db0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:8109:x1873906353972224:12345-0@lo:101:mdt00_003.0 Request processed in 3808us (7879us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096584.137764:0:7418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1787096584.137848:0:6473:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345504384 00000100:00100000:0.0:1787096584.137860:0:6473:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345504384 00010000:00010000:0.0:1787096584.137884:0:6473:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96174340fe00/0xa979d75fc166be35 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2002 expref: 7 pid: 6489 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096584.137919:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 65 00000100:00100000:0.0:1787096584.137928:0:6473:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9618589ca050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:70e19547-606a-4706-b016-3476e377d7df+7:2400:x1873906345504384:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787096584.137940:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787096584.137946:0:6473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96174340fe00/0xa979d75fc166be35 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2002 expref: 7 pid: 6489 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.137959:0:6473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96174340fe00/0xa979d75fc166be35 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2002 expref: 7 pid: 6489 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.137978:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96174340fe00/0xa979d75fc166be35 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2002 expref: 7 pid: 6489 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.137988:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9618472ca600) 00010000:00010000:0.0:1787096584.137993:0:6473:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4b600/0xa979d75fc166bf46 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xa979d75fc166bf3f expref: 6 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.138004:0:6473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4b600/0xa979d75fc166bf46 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xa979d75fc166bf3f expref: 6 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.138013:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4b600/0xa979d75fc166bf46 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xa979d75fc166bf3f expref: 6 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.138042:0:6473:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4b600/0xa979d75fc166bf46 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xa979d75fc166bf3f expref: 6 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096584.138066:0:6473:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96187c9e5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:6473:1873906353972480:0@lo:105: 00000100:00100000:0.0:1787096584.138096:0:6473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096584.138130:0:6473:0:(client.c:2692:ptlrpc_set_wait()) set ffff961741ec3cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787096584.138235:0:8379:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353972480 00000100:00100000:2.0:1787096584.138240:0:8379:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353972480 00000100:00100000:2.0:1787096584.138275:0:8379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787096584.138283:0:8379:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96187c9e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:6473:x1873906353972480:12345-0@lo:105: 00010000:00010000:2.0:1787096584.138293:0:8379:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff96186ddf5c00/0xa979d75fc166bf3f lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa979d75fc166bf46 expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.138303:0:8379:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff96186ddf5c00/0xa979d75fc166bf3f lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa979d75fc166bf46 expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.138312:0:8379:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff96186ddf5c00/0xa979d75fc166bf3f lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xa979d75fc166bf46 expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.138320:0:8379:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff96186ddf5c00/0xa979d75fc166bf3f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xa979d75fc166bf46 expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.138327:0:8379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff96186ddf5c00/0xa979d75fc166bf3f lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xa979d75fc166bf46 expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.138349:0:8379:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff96186ddf5c00/0xa979d75fc166bf3f lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xa979d75fc166bf46 expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.138362:0:8379:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff96186ddf5c00) 00000100:00100000:2.0:1787096584.138400:0:8379:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96187c9e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:6473:x1873906353972480:12345-0@lo:105: Request processed in 117us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096584.138406:0:8379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787096584.138671:0:6473:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96187c9e5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:6473:1873906353972480:0@lo:105: 00010000:00010000:2.0:1787096584.138684:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787096584.138964:0:6473:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9618589ca050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:70e19547-606a-4706-b016-3476e377d7df+6:2400:x1873906345504384:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 1035us (1391us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096584.138972:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 65 00000100:00100000:0.0:1787096584.140522:0:8109:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742db0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8109:1873906353972224:0@lo:101:mdt00_003.0 00010000:00010000:0.0:1787096584.140612:0:8109:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff96186ddf5c00/0xa979d75fc166bf3f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa979d75fc166bf46 expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787096584.140636:0:8109:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1787096584.140672:0:8109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff96174340f800/0xa979d75fc166bf4d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9280d55e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.140681:0:8109:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff96174340f800/0xa979d75fc166bf4d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9280d55e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.140691:0:8109:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff96174340f800/0xa979d75fc166bf4d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9280d55e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096584.140708:0:8109:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96187c9e6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8109:1873906353972608:0@lo:101:mdt00_003.0 00000100:00100000:0.0:1787096584.140747:0:8109:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096584.140772:0:8109:0:(client.c:2692:ptlrpc_set_wait()) set ffff961741ec3cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787096584.140792:0:6493:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353972608 00000100:00100000:0.0:1787096584.140797:0:6493:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353972608 00000100:00100000:0.0:1787096584.140845:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1787096584.140855:0:6493:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96187c9e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:8109:x1873906353972608:12345-0@lo:101:mdt00_003.0 00010000:00010000:0.0:1787096584.140870:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787096584.140884:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f600/0xa979d75fc166bf54 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9280d55e bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa979d75fc166bf4d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.140918:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f600/0xa979d75fc166bf54 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9280d55e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xa979d75fc166bf4d expref: 8 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.140932:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f600/0xa979d75fc166bf54 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9280d55e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xa979d75fc166bf4d expref: 8 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.140940:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9280d55e (ffff961741932c00) 00010000:00010000:0.0:1787096584.140944:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096584.140947:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96174340f600, rc 0) 00000100:00100000:0.0:1787096584.140987:0:6493:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96187c9e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:8109:x1873906353972608:12345-0@lo:101:mdt00_003.0 Request processed in 134us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096584.140995:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1787096584.141351:0:8109:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96187c9e6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8109:1873906353972608:0@lo:101:mdt00_003.0 00010000:00010000:0.0:1787096584.141597:0:8109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff96174340f800/0xa979d75fc166bf4d lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9280d55e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xa979d75fc166bf54 expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.141610:0:8109:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff96174340f800/0xa979d75fc166bf4d lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9280d55e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa979d75fc166bf54 expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787096584.141624:0:8109:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:0.0:1787096584.141657:0:8109:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96187c9e6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8109:1873906353972736:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787096584.141685:0:8109:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096584.141708:0:8109:0:(client.c:2692:ptlrpc_set_wait()) set ffff961741ec3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787096584.141731:0:7418:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353972736 00000100:00100000:3.0:1787096584.141736:0:7418:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353972736 00000100:00100000:3.0:1787096584.141766:0:7418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1787096584.141773:0:7418:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96187c9e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:8109:x1873906353972736:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787096584.141852:0:7418:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96187c9e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:8109:x1873906353972736:12345-0@lo:1000:mdt00_003.0 Request processed in 80us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096584.141860:0:7418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1787096584.141880:0:8109:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96187c9e6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8109:1873906353972736:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787096584.141919:0:8109:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96187c9e6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8109:1873906353972864:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787096584.141946:0:8109:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096584.141962:0:8109:0:(client.c:2692:ptlrpc_set_wait()) set ffff961741ec3c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787096584.142067:0:6494:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353972864 00000100:00100000:1.0:1787096584.142072:0:6494:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353972864 00000100:00100000:1.0:1787096584.142103:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1787096584.142111:0:6494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96187c9e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:8109:x1873906353972864:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787096584.142185:0:6494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96187c9e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:8109:x1873906353972864:12345-0@lo:1000:mdt00_003.0 Request processed in 75us (237us total) trans 0 rc 1/1 00000100:00100000:1.0:1787096584.142193:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1787096584.142198:0:8109:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96187c9e6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8109:1873906353972864:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1787096584.142241:0:8109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff96174340fe00/0xa979d75fc166bf5b lrc: 3/0,1 mode: --/EX res: [0x240000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.142249:0:8109:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff96174340fe00/0xa979d75fc166bf5b lrc: 3/0,1 mode: --/EX res: [0x240000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.142256:0:8109:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff96174340fe00/0xa979d75fc166bf5b lrc: 3/0,1 mode: --/EX res: [0x240000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096584.142361:0:8109:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96187c9e6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8109:1873906353972992:0@lo:101:mdt00_003.0 00000100:00100000:0.0:1787096584.142466:0:8109:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096584.142482:0:8109:0:(client.c:2692:ptlrpc_set_wait()) set ffff961741ec3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787096584.144342:0:7418:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353972992 00000100:00100000:3.0:1787096584.144350:0:7418:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353972992 00000100:00100000:3.0:1787096584.144389:0:7418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1787096584.144397:0:7418:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96187c9e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:8109:x1873906353972992:12345-0@lo:101:mdt00_003.0 00010000:00010000:3.0:1787096584.144411:0:7418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787096584.144428:0:7418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961840030e00/0xa979d75fc166bf62 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa979d75fc166bf5b expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096584.144481:0:7418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961840030e00/0xa979d75fc166bf62 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xa979d75fc166bf5b expref: 9 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096584.144494:0:7418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961840030e00/0xa979d75fc166bf62 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xa979d75fc166bf5b expref: 9 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096584.144502:0:7418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3:0x0].0x0 (ffff96184a9ea200) 00010000:00010000:3.0:1787096584.144505:0:7418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787096584.144509:0:7418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961840030e00, rc 0) 00000100:00100000:3.0:1787096584.144558:0:7418:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96187c9e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:8109:x1873906353972992:12345-0@lo:101:mdt00_003.0 Request processed in 161us (2090us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096584.144566:0:7418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1787096584.144583:0:8109:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96187c9e6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8109:1873906353972992:0@lo:101:mdt00_003.0 00010000:00010000:0.0:1787096584.144601:0:8109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff96174340fe00/0xa979d75fc166bf5b lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xa979d75fc166bf62 expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.144613:0:8109:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff96174340fe00/0xa979d75fc166bf5b lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa979d75fc166bf62 expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.144641:0:8109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff96174340fc00/0xa979d75fc166bf69 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.144762:0:8109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96174340fc00/0xa979d75fc166bf69 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.144771:0:8109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96174340fc00/0xa979d75fc166bf69 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.144799:0:8109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff96174340ee00/0xa979d75fc166bf70 lrc: 3/0,1 mode: --/EX res: [0x240000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.144807:0:8109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96174340ee00/0xa979d75fc166bf70 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.144813:0:8109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96174340ee00/0xa979d75fc166bf70 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.144847:0:8109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff96174340e800/0xa979d75fc166bf77 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.144853:0:8109:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff96174340e800/0xa979d75fc166bf77 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.144861:0:8109:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff96174340e800/0xa979d75fc166bf77 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096584.144876:0:8109:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96187c9e6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8109:1873906353973120:0@lo:101:mdt00_003.0 00000100:00100000:0.0:1787096584.144905:0:8109:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096584.144932:0:8109:0:(client.c:2692:ptlrpc_set_wait()) set ffff961741ec3cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787096584.146026:0:6494:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353973120 00000100:00100000:1.0:1787096584.146032:0:6494:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353973120 00000100:00100000:1.0:1787096584.146068:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1787096584.146076:0:6494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96187c9e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:8109:x1873906353973120:12345-0@lo:101:mdt00_003.0 00010000:00010000:1.0:1787096584.146092:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096584.146104:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4600/0xa979d75fc166bf7e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa979d75fc166bf77 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096584.146127:0:6494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4be00/0xa979d75fc166be7b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b201e expref: 5 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096584.146137:0:6494:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4600/0xa979d75fc166bf7e lrc: 4/0,0 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xa979d75fc166bf77 expref: 10 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096584.146160:0:6494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4be00/0xa979d75fc166be7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b201e expref: 5 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096584.146173:0:6494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4be00/0xa979d75fc166be7b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b201e expref: 5 pid: 6488 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096584.146184:0:6494:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742db1500 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:6494:1873906353973248:192.168.201.40@tcp:104: 00000100:00100000:1.0:1787096584.146248:0:6494:0:(client.c:2692:ptlrpc_set_wait()) set ffff96187cad6cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787096584.149490:0:6494:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742db1500 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:6494:1873906353973248:192.168.201.40@tcp:104: 00010000:00010000:1.0:1787096584.149522:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4600/0xa979d75fc166bf7e lrc: 3/0,0 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xa979d75fc166bf77 expref: 10 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096584.149535:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff961742a27200) 00010000:00010000:1.0:1787096584.149538:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787096584.149543:0:6494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4600/0xa979d75fc166bf7e lrc: 3/0,0 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xa979d75fc166bf77 expref: 10 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096584.149566:0:6494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4600/0xa979d75fc166bf7e lrc: 3/0,0 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xa979d75fc166bf77 expref: 10 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096584.149574:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96186ddf4600, rc 0) 00000100:00100000:2.0:1787096584.149580:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1787096584.149625:0:6494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96187c9e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:8109:x1873906353973120:12345-0@lo:101:mdt00_003.0 Request processed in 3550us (4720us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096584.149634:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1787096584.149639:0:8109:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96187c9e6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8109:1873906353973120:0@lo:101:mdt00_003.0 00010000:00010000:2.0:1787096584.149654:0:8109:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff96174340e800/0xa979d75fc166bf77 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xa979d75fc166bf7e expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.149664:0:8109:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff96174340e800/0xa979d75fc166bf77 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa979d75fc166bf7e expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096584.149933:0:7412:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345504512 00000100:00100000:3.0:1787096584.149941:0:7412:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345504512 00010000:00010000:3.0:1787096584.149973:0:7412:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4be00/0xa979d75fc166be7b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b201e expref: 6 pid: 6488 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096584.150101:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 66 00000100:00100000:2.0:1787096584.150112:0:8380:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961875503480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:70e19547-606a-4706-b016-3476e377d7df+6:2400:x1873906345504512:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787096584.150125:0:8380:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787096584.150131:0:8380:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4be00/0xa979d75fc166be7b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b201e expref: 6 pid: 6488 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.150149:0:8380:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4be00/0xa979d75fc166be7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b201e expref: 6 pid: 6488 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.150165:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4be00/0xa979d75fc166be7b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b201e expref: 6 pid: 6488 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.150176:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff961742a27200) 00010000:00010000:2.0:1787096584.150180:0:8380:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4600/0xa979d75fc166bf7e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xa979d75fc166bf77 expref: 9 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.150188:0:8380:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4600/0xa979d75fc166bf7e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xa979d75fc166bf77 expref: 9 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.150195:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4600/0xa979d75fc166bf7e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xa979d75fc166bf77 expref: 9 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.150222:0:8380:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4600/0xa979d75fc166bf7e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xa979d75fc166bf77 expref: 9 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096584.150234:0:8380:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742c64700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:8380:1873906353973376:0@lo:105: 00000100:00100000:2.0:1787096584.150267:0:8380:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096584.150343:0:8380:0:(client.c:2692:ptlrpc_set_wait()) set ffff961742a35d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787096584.150377:0:7411:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353973376 00000100:00100000:1.0:1787096584.150381:0:7411:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353973376 00000100:00100000:1.0:1787096584.150415:0:7411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787096584.150423:0:7411:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961850224380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:8380:x1873906353973376:12345-0@lo:105: 00010000:00010000:1.0:1787096584.150432:0:7411:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff96174340e800/0xa979d75fc166bf77 lrc: 5/0,1 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa979d75fc166bf7e expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096584.150584:0:7411:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff96174340e800/0xa979d75fc166bf77 lrc: 5/0,1 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa979d75fc166bf7e expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096584.150594:0:7411:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff96174340e800/0xa979d75fc166bf77 lrc: 5/0,1 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xa979d75fc166bf7e expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096584.150601:0:7411:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff96174340e800/0xa979d75fc166bf77 lrc: 5/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xa979d75fc166bf7e expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096584.150608:0:7411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff96174340e800/0xa979d75fc166bf77 lrc: 6/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xa979d75fc166bf7e expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096584.150616:0:7411:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff96174340e800/0xa979d75fc166bf77 lrc: 6/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xa979d75fc166bf7e expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096584.150681:0:7411:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff96174340e800) 00000100:00100000:1.0:1787096584.150729:0:7411:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961850224380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:8380:x1873906353973376:12345-0@lo:105: Request processed in 306us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096584.150737:0:7411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787096584.150804:0:8380:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742c64700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:8380:1873906353973376:0@lo:105: 00010000:00010000:3.0:1787096584.150820:0:8380:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787096584.150879:0:8380:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961875503480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:70e19547-606a-4706-b016-3476e377d7df+5:2400:x1873906345504512:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 770us (1300us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096584.150886:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 66 00010000:00010000:2.0:1787096584.151022:0:8109:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff96174340e800/0xa979d75fc166bf77 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa979d75fc166bf7e expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.151031:0:8109:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff96174340e800/0xa979d75fc166bf77 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa979d75fc166bf7e expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096584.151986:0:8109:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961850226680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8109:1873906353973504:0@lo:403:mdt00_003.0 00000100:00100000:2.0:1787096584.152032:0:8109:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096584.152090:0:8109:0:(client.c:2692:ptlrpc_set_wait()) set ffff961742a35900 going to sleep for 11 seconds 00000100:00100000:1.0:1787096584.152193:0:7418:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353973504 00000100:00100000:1.0:1787096584.152198:0:7418:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353973504 00000100:00100000:1.0:1787096584.152273:0:7418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1787096584.152280:0:7418:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742de8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:8109:x1873906353973504:12345-0@lo:403:mdt00_003.0 00000100:00100000:0.0:1787096584.154061:0:7418:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742de8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:8109:x1873906353973504:12345-0@lo:403:mdt00_003.0 Request processed in 1768us (2016us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096584.154072:0:7418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1787096584.154106:0:8109:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961850226680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8109:1873906353973504:0@lo:403:mdt00_003.0 00000040:00080000:2.0:1787096584.155228:0:8109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].4, 936 off38944 00000040:00080000:2.0:1787096584.155387:0:8109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].4, 1016 off39504 00000004:00080000:2.0:1787096584.155395:0:8109:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff961742a35900 with version 7 00000004:00080000:0.0:1787096584.155728:0:7416:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff96184550da80 version 7 rpc_version 7 00000020:00100000:0.0:1787096584.155757:0:7416:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787096584.155764:0:7416:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff96187c9e6d80 x1873906353973760/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2592/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787096584.155783:0:7416:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96187c9e6d80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7416:1873906353973760:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787096584.155845:0:7416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096584.155867:0:7416:0:(client.c:2692:ptlrpc_set_wait()) set ffff961741ec3c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787096584.156371:0:6494:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353973760 00000100:00100000:1.0:1787096584.156378:0:6494:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353973760 00000100:00100000:1.0:1787096584.156426:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1787096584.156435:0:6494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742e3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:7416:x1873906353973760:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787096584.156769:0:6494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742e3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:7416:x1873906353973760:12345-0@lo:1000:osp_up0-1.0 Request processed in 335us (923us total) trans 4294967361 rc 0/0 00000100:00100000:1.0:1787096584.156777:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1787096584.156897:0:7416:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96187c9e6d80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7416:1873906353973760:0@lo:1000:osp_up0-1.0 00000004:00200000:2.0:1787096584.157075:0:8109:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1787096584.157094:0:8109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff96174340ee00/0xa979d75fc166bf70 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.157104:0:8109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff96174340ee00/0xa979d75fc166bf70 lrc: 2/0,0 mode: EX/EX res: [0x240000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.157112:0:8109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff96174340ee00/0xa979d75fc166bf70 lrc: 3/0,0 mode: EX/EX res: [0x240000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.157118:0:8109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96174340ee00 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:2.0:1787096584.157123:0:8109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96174340ee00/0xa979d75fc166bf70 lrc: 3/0,0 mode: EX/EX res: [0x240000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.157131:0:8109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96174340ee00/0xa979d75fc166bf70 lrc: 4/0,0 mode: EX/EX res: [0x240000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.157146:0:8109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0x0 (ffff961741932900) 00010000:00010000:2.0:1787096584.157149:0:8109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787096584.157154:0:8109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff96174340ee00/0xa979d75fc166bf70 lrc: 2/0,0 mode: --/EX res: [0x240000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.157173:0:8109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96174340ee00/0xa979d75fc166bf70 lrc: 0/0,0 mode: --/EX res: [0x240000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.157194:0:8109:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff96174340e800/0xa979d75fc166bf77 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa979d75fc166bf7e expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.157202:0:8109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff96174340e800/0xa979d75fc166bf77 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xa979d75fc166bf7e expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.157208:0:8109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff96174340e800/0xa979d75fc166bf77 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xa979d75fc166bf7e expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.157228:0:8109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1787096584.157235:0:8109:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000401:0x5:0x0] 00010000:00010000:2.0:1787096584.157240:0:8109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff96174340fc00/0xa979d75fc166bf69 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.157246:0:8109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff96174340fc00/0xa979d75fc166bf69 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.157251:0:7858:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787096584.157252:0:8109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff96174340fc00/0xa979d75fc166bf69 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.157258:0:7858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff96174340e800/0xa979d75fc166bf77 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xa979d75fc166bf7e expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.157259:0:8109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96174340fc00 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:2.0:1787096584.157264:0:8109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96174340fc00/0xa979d75fc166bf69 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.157272:0:7858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96174340e800 already unused, calling callback (ffffffffc1765ee0) 00010000:00010000:0.0:1787096584.157277:0:7858:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff96174340e800/0xa979d75fc166bf77 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xa979d75fc166bf7e expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787096584.157286:0:7858:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff96174340e800/0xa979d75fc166bf77 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xa979d75fc166bf7e expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.157310:0:7858:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff96174340e800/0xa979d75fc166bf77 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xa979d75fc166bf7e expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.157326:0:7858:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787096584.157341:0:8109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96174340fc00/0xa979d75fc166bf69 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.157364:0:8109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3:0x0].0x0 (ffff961741932100) 00010000:00010000:2.0:1787096584.157367:0:8109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096584.157371:0:8109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff96174340fc00/0xa979d75fc166bf69 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096584.157372:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961848f89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1873906353973888:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787096584.157383:0:8109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96174340fc00/0xa979d75fc166bf69 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.157398:0:8109:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff96174340fe00/0xa979d75fc166bf5b lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa979d75fc166bf62 expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.157405:0:8109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff96174340fe00/0xa979d75fc166bf5b lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xa979d75fc166bf62 expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096584.157413:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787096584.157420:0:8109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff96174340fe00/0xa979d75fc166bf5b lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xa979d75fc166bf62 expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.157499:0:7858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff96174340e800/0xa979d75fc166bf77 lrc: 1/0,0 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xa979d75fc166bf7e expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096584.157502:0:6474:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353973888 00000100:00100000:3.0:1787096584.157509:0:6474:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353973888 00010000:00010000:0.0:1787096584.157510:0:7858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff96174340e800/0xa979d75fc166bf77 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xa979d75fc166bf7e expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.157528:0:7858:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787096584.157533:0:7858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff96174340fe00/0xa979d75fc166bf5b lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xa979d75fc166bf62 expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.157539:0:7858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96174340fe00 already unused, calling callback (ffffffffc1765ee0) 00000100:00100000:3.0:1787096584.157545:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1787096584.157550:0:7858:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff96174340fe00/0xa979d75fc166bf5b lrc: 5/0,0 mode: EX/EX res: [0x240000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xa979d75fc166bf62 expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096584.157556:0:6474:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742db1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+11:3636:x1873906353973888:12345-0@lo:103:ldlm_bl.0 00000004:00010000:0.0:1787096584.157563:0:7858:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff96174340fe00/0xa979d75fc166bf5b lrc: 5/0,0 mode: EX/EX res: [0x240000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xa979d75fc166bf62 expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096584.157581:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787096584.157585:0:7858:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff96174340fe00/0xa979d75fc166bf5b lrc: 4/0,0 mode: --/EX res: [0x240000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xa979d75fc166bf62 expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.157592:0:7858:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787096584.157598:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4600/0xa979d75fc166bf7e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xa979d75fc166bf77 expref: 11 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096584.157667:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff961742a27200) 00010000:00010000:3.0:1787096584.157676:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787096584.157719:0:8109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00000004:00080000:2.0:1787096584.157729:0:8109:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1787096584.157735:0:6476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787096584.157750:0:7858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff96174340fe00/0xa979d75fc166bf5b lrc: 1/0,0 mode: --/EX res: [0x240000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xa979d75fc166bf62 expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.157754:0:8109:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff96186ddf5c00/0xa979d75fc166bf3f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa979d75fc166bf46 expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.157765:0:7858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff96174340fe00/0xa979d75fc166bf5b lrc: 0/0,0 mode: --/EX res: [0x240000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xa979d75fc166bf62 expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.157770:0:8109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff96186ddf5c00/0xa979d75fc166bf3f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xa979d75fc166bf46 expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.157779:0:8109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff96186ddf5c00/0xa979d75fc166bf3f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xa979d75fc166bf46 expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.157784:0:7858:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787096584.157786:0:7858:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787096584.157788:0:7858:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787096584.157814:0:8109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1787096584.157819:0:8109:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1787096584.157823:0:8109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff96174340f800/0xa979d75fc166bf4d lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9280d55e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xa979d75fc166bf54 expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.157828:0:10297:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787096584.157830:0:8109:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff96174340f800/0xa979d75fc166bf4d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9280d55e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xa979d75fc166bf54 expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.157844:0:10297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff96186ddf5c00/0xa979d75fc166bf3f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xa979d75fc166bf46 expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.157852:0:10297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96186ddf5c00 already unused, calling callback (ffffffffc1765ee0) 00010000:00010000:0.0:1787096584.157855:0:10297:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff96186ddf5c00/0xa979d75fc166bf3f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xa979d75fc166bf46 expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787096584.157863:0:10297:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff96186ddf5c00/0xa979d75fc166bf3f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xa979d75fc166bf46 expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.157893:0:10297:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff96186ddf5c00/0xa979d75fc166bf3f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xa979d75fc166bf46 expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096584.157898:0:8109:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961875503100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70e19547-606a-4706-b016-3476e377d7df+11:34759:x1873906345504256:12345-192.168.201.40@tcp:36:rm.0 Request processed in 28237us (28344us total) trans 4294967316 rc 0/0 00010000:00010000:0.0:1787096584.157905:0:10297:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787096584.157912:0:8109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 181 00010000:00010000:0.0:1787096584.157926:0:10297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff96186ddf5c00/0xa979d75fc166bf3f lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xa979d75fc166bf46 expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.157933:0:10297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff96186ddf5c00/0xa979d75fc166bf3f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xa979d75fc166bf46 expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096584.157944:0:10297:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787096584.157945:0:10297:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787096584.157947:0:10297:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787096584.157954:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787096584.157962:0:3635:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961848f8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1873906353974144:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787096584.157987:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096584.158062:0:6473:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353974144 00000100:00100000:2.0:1787096584.158067:0:6473:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353974144 00000100:00100000:2.0:1787096584.158096:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787096584.158110:0:6473:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96187574b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+11:3635:x1873906353974144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787096584.158117:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787096584.158127:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4b600/0xa979d75fc166bf46 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xa979d75fc166bf3f expref: 11 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096584.158139:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9618472ca600) 00010000:00010000:2.0:1787096584.158142:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787096584.158169:0:6473:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96187574b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+10:3635:x1873906353974144:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096584.158175:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787096584.158199:0:3635:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961848f8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1873906353974144:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787096584.158373:0:6474:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742db1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+9:3636:x1873906353973888:12345-0@lo:103:ldlm_bl.0 Request processed in 819us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096584.158380:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787096584.158607:0:3636:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961848f89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1873906353973888:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787096584.158617:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787096584.158622:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961848f8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1873906353974016:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787096584.158646:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096584.158672:0:8380:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353974016 00000100:00100000:3.0:1787096584.158678:0:8380:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353974016 00000100:00100000:3.0:1787096584.158719:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787096584.158728:0:8380:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742db2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+9:3636:x1873906353974016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787096584.158736:0:8380:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787096584.158747:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961840030e00/0xa979d75fc166bf62 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xa979d75fc166bf5b expref: 9 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096584.158759:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3:0x0].0x0 (ffff96184a9ea200) 00010000:00010000:3.0:1787096584.158765:0:8380:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787096584.158798:0:8380:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742db2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+8:3636:x1873906353974016:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096584.158805:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787096584.158818:0:3636:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961848f8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1873906353974016:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787096584.462606:0:6477:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787096584.477327:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1787096584.477378:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1787096584.477399:0:6483:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345504640 00000100:00100000:3.0:1787096584.477415:0:6483:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345504640 00000100:00100000:2.0:1787096584.477416:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1787096584.477479:0:9989:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345504896 00000100:00100000:0.0:1787096584.477484:0:9989:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345504896 00000100:00100000:3.0:1787096584.477503:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 326 00000100:00100000:3.0:1787096584.477516:0:6483:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961850220450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d421c913-8ded-4ece-9979-167ed163b87c+9:2401:x1873906345504640:12345-192.168.201.40@tcp:400:kworker.0 00000100:00100000:0.0:1787096584.477521:0:9989:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345504768 00000100:00100000:0.0:1787096584.477525:0:9989:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345504768 00000100:00100000:0.0:1787096584.477555:0:9989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 280 00000100:00100000:0.0:1787096584.477564:0:9989:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742de9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:70e19547-606a-4706-b016-3476e377d7df+11:2401:x1873906345504896:12345-192.168.201.40@tcp:400:kworker.0 00000100:00100000:1.0:1787096584.477566:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 281 00000100:00100000:1.0:1787096584.477578:0:6490:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742dead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70e19547-606a-4706-b016-3476e377d7df+5:2401:x1873906345504768:12345-192.168.201.40@tcp:400:kworker.0 00000100:00100000:1.0:1787096584.477629:0:6490:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742dead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70e19547-606a-4706-b016-3476e377d7df+5:2401:x1873906345504768:12345-192.168.201.40@tcp:400:kworker.0 Request processed in 54us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096584.477634:0:9989:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742de9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:70e19547-606a-4706-b016-3476e377d7df+11:2401:x1873906345504896:12345-192.168.201.40@tcp:400:kworker.0 Request processed in 69us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096584.477636:0:6483:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961850220450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d421c913-8ded-4ece-9979-167ed163b87c+9:2401:x1873906345504640:12345-192.168.201.40@tcp:400:kworker.0 Request processed in 120us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096584.477646:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 281 00000100:00100000:3.0:1787096584.477656:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 326 00000100:00100000:0.0:1787096584.477656:0:9989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 280 00000100:00100000:3.0:1787096584.782657:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787096584.782680:0:3634:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742fd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1873906353974272:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787096584.782745:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096584.782789:0:8366:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353974272 00000100:00100000:0.0:1787096584.782798:0:8366:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353974272 00000100:00100000:1.0:1787096584.782869:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961875748e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1873906353974400:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787096584.782883:0:8366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787096584.782895:0:8366:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1873906353974272:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787096584.782904:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1787096584.782926:0:8366:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787096584.782942:0:8453:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353974400 00000100:00100000:1.0:1787096584.782946:0:8453:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353974400 00000100:00100000:1.0:1787096584.782980:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787096584.782982:0:8366:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1873906353974272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096584.782991:0:8453:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742db1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1873906353974400:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1787096584.782995:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787096584.782997:0:8366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00002000:00000024:1.0:1787096584.783007:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787096584.783038:0:3634:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742fd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1873906353974272:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787096584.783048:0:8453:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742db1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1873906353974400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096584.783055:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787096584.783087:0:3636:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961875748e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1873906353974400:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787096584.783555:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787096584.783568:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742fd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3636:1873906353974912:0@lo:400:kworker.0 00000100:00100000:3.0:1787096584.783604:0:3635:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742fd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1873906353974784:0@lo:400:kworker.0 00000100:00100000:0.0:1787096584.783611:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096584.783635:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096584.783654:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742fd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ef59912-d6a3-4393-bae9-348c8f3519b6:3636:1873906353974528:0@lo:400:kworker.0 00000100:00100000:3.0:1787096584.783657:0:3635:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742fd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1873906353975296:0@lo:400:kworker.0 00000100:00100000:3.0:1787096584.783683:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096584.783697:0:3635:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742fd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3635:1873906353975808:0@lo:400:kworker.0 00000100:00100000:0.0:1787096584.783704:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096584.783721:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096584.783746:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787096584.783747:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742fd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1873906353975424:0@lo:400:kworker.0 00000100:00100000:3.0:1787096584.783752:0:3635:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742fd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3635:1873906353974656:0@lo:400:kworker.0 00000100:00100000:3.0:1787096584.783780:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096584.783795:0:3635:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742fd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3635:1873906353975168:0@lo:400:kworker.0 00000100:00100000:0.0:1787096584.783796:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096584.783819:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096584.783840:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787096584.783850:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742fd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3636:1873906353975040:0@lo:400:kworker.0 00000100:00100000:3.0:1787096584.783854:0:3635:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742fd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3635:1873906353975680:0@lo:400:kworker.0 00000100:00100000:1.0:1787096584.783869:0:6494:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353974784 00000100:00100000:1.0:1787096584.783875:0:6494:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353974784 00000100:00100000:0.0:1787096584.783887:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096584.783895:0:10250:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353975296 00000100:00100000:3.0:1787096584.783899:0:10250:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353975296 00000100:00100000:1.0:1787096584.783912:0:6494:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353975424 00000100:00100000:1.0:1787096584.783916:0:6494:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353975424 00000100:00100000:0.0:1787096584.783921:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742fd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1873906353975552:0@lo:400:kworker.0 00000100:00100000:3.0:1787096584.783934:0:10250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787096584.783944:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1787096584.783945:0:10250:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742cc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3635:x1873906353975296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096584.783952:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096584.783959:0:6494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742c64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:3635:x1873906353974784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096584.783990:0:7418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1787096584.783995:0:10250:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742cc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3635:x1873906353975296:12345-0@lo:400:kworker.0 Request processed in 53us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096584.784002:0:10250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787096584.784006:0:7418:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96187c8d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1873906353975424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096584.784014:0:6494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742c64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:3635:x1873906353974784:12345-0@lo:400:kworker.0 Request processed in 56us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096584.784016:0:10250:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353975552 00000100:00100000:3.0:1787096584.784020:0:10250:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353975552 00000100:00100000:1.0:1787096584.784025:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1787096584.784047:0:10250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787096584.784054:0:10250:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96187c8d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3636:x1873906353975552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096584.784060:0:7418:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96187c8d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1873906353975424:12345-0@lo:400:kworker.0 Request processed in 57us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096584.784069:0:7418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1787096584.784083:0:10250:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96187c8d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3636:x1873906353975552:12345-0@lo:400:kworker.0 Request processed in 30us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096584.784088:0:10250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787096584.784098:0:9989:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353974912 00000100:00100000:3.0:1787096584.784108:0:6482:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353974528 00000100:00100000:0.0:1787096584.784109:0:9989:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353974912 00000100:00100000:3.0:1787096584.784112:0:6482:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353974528 00000100:00100000:3.0:1787096584.784148:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1787096584.784152:0:6482:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961850222450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef59912-d6a3-4393-bae9-348c8f3519b6+23:3636:x1873906353974528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096584.784153:0:9989:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353975808 00000100:00100000:0.0:1787096584.784158:0:9989:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353975808 00000100:00100000:3.0:1787096584.784179:0:6482:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961850222450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef59912-d6a3-4393-bae9-348c8f3519b6+23:3636:x1873906353974528:12345-0@lo:400:kworker.0 Request processed in 26us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096584.784183:0:9989:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353974656 00000100:00100000:3.0:1787096584.784186:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1787096584.784188:0:9989:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353974656 00000100:00100000:0.0:1787096584.784203:0:9989:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353975168 00000100:00100000:0.0:1787096584.784206:0:9989:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353975168 00000100:00100000:3.0:1787096584.784225:0:6488:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353975040 00000100:00100000:3.0:1787096584.784230:0:6488:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353975040 00000100:00100000:0.0:1787096584.784230:0:9989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1787096584.784242:0:9989:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961875748e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1873906353974912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096584.784261:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1787096584.784271:0:6488:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961848f99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1873906353975808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096584.784283:0:9989:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961875748e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1873906353974912:12345-0@lo:400:kworker.0 Request processed in 43us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096584.784291:0:9989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1787096584.784309:0:9989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1787096584.784314:0:6488:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961848f99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1873906353975808:12345-0@lo:400:kworker.0 Request processed in 45us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096584.784320:0:9989:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961848f9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1873906353974656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096584.784325:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1787096584.784351:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1787096584.784360:0:9989:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961848f9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1873906353974656:12345-0@lo:400:kworker.0 Request processed in 44us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096584.784361:0:6488:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961848f99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1873906353975168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096584.784373:0:9989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1787096584.784391:0:9989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1787096584.784399:0:9989:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96187c8d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1873906353975040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096584.784420:0:6488:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961848f99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1873906353975168:12345-0@lo:400:kworker.0 Request processed in 61us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096584.784427:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1787096584.784478:0:9989:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96187c8d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1873906353975040:12345-0@lo:400:kworker.0 Request processed in 81us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096584.784484:0:9989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1787096584.784516:0:3636:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742fd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3636:1873906353975040:0@lo:400:kworker.0 00010000:00080000:0.0:1787096584.784532:0:3636:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961742fd0380 x1873906353975552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787096600 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787096584.784541:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787096584.784544:0:3636:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742fd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1873906353975552:0@lo:400:kworker.0 00000100:00080000:3.0:1787096584.784546:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787096584.784550:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787096584.784566:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096584.784572:0:3636:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742fd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1873906353975424:0@lo:400:kworker.0 00000100:00100000:0.0:1787096584.784583:0:3636:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742fd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3636:1873906353974912:0@lo:400:kworker.0 00000100:00100000:0.0:1787096584.784596:0:3636:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742fd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ef59912-d6a3-4393-bae9-348c8f3519b6:3636:1873906353974528:0@lo:400:kworker.0 00000100:00100000:3.0:1787096584.784609:0:3635:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742fd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1873906353974784:0@lo:400:kworker.0 00000100:00100000:1.0:1787096584.784622:0:9989:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353975680 00000100:00100000:1.0:1787096584.784627:0:9989:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353975680 00010000:00080000:3.0:1787096584.784629:0:3635:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961742fd1500 x1873906353975296/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787096600 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787096584.784639:0:3635:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742fd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1873906353975296:0@lo:400:kworker.0 00000100:00100000:3.0:1787096584.784651:0:3635:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742fd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3635:1873906353975808:0@lo:400:kworker.0 00000100:00080000:1.0:1787096584.784666:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787096584.784676:0:3635:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742fd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3635:1873906353974656:0@lo:400:kworker.0 00000100:00100000:0.0:1787096584.784692:0:9989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1787096584.784693:0:3635:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742fd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3635:1873906353975168:0@lo:400:kworker.0 00000100:00100000:0.0:1787096584.784705:0:9989:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961848f9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1873906353975680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096584.784743:0:9989:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961848f9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1873906353975680:12345-0@lo:400:kworker.0 Request processed in 42us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096584.784750:0:9989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1787096584.784761:0:3635:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742fd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3635:1873906353975680:0@lo:400:kworker.0 00000001:02000400:0.0:1787096584.827742:0:22225:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 23c: fallocate on EC file ============== 19:43:03 (1787096583) 00000100:00100000:0.0:1787096585.281111:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1787096585.281168:0:6489:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345505024 00000100:00100000:2.0:1787096585.281182:0:6489:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345505024 00000100:00100000:2.0:1787096585.281263:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 182 00000100:00100000:2.0:1787096585.281276:0:6489:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96187c8d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70e19547-606a-4706-b016-3476e377d7df+5:34943:x1873906345505024:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1787096585.281303:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096585.281336:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4a000/0xa979d75fc166bf85 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2ded7f867b205d expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096585.281425:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4a600/0xa979d75fc166bf8c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096585.281458:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4a600/0xa979d75fc166bf8c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096585.281472:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4a600/0xa979d75fc166bf8c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787096585.281527:0:6489:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787096585.281532:0:6489:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787096585.281557:0:6489:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4a600/0xa979d75fc166bf8c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096585.281580:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4a000/0xa979d75fc166bf85 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b205d expref: 7 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096585.281594:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4a600/0xa979d75fc166bf8c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b205d expref: 6 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096585.281610:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9618472ca600) 00010000:00010000:2.0:1787096585.281613:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787096585.281616:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961845b4a600, rc 0) 00000100:00100000:2.0:1787096585.281686:0:6489:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96187c8d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70e19547-606a-4706-b016-3476e377d7df+6:34943:x1873906345505024:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 412us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096585.281695:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 182 00000100:00100000:2.0:1787096585.282749:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1787096585.282779:0:8109:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345505152 00000100:00100000:3.0:1787096585.282786:0:8109:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345505152 00000100:00100000:2.0:1787096585.282876:0:8109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 183 00000100:00100000:2.0:1787096585.282888:0:8109:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742de8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70e19547-606a-4706-b016-3476e377d7df+6:34943:x1873906345505152:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1787096585.282900:0:8109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096585.282911:0:8109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4b200/0xa979d75fc166bf93 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2ded7f867b2064 expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096585.282955:0:8109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4bc00/0xa979d75fc166bf9a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096585.282966:0:8109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4bc00/0xa979d75fc166bf9a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096585.282975:0:8109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4bc00/0xa979d75fc166bf9a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096585.283124:0:8109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4b400/0xa979d75fc166bfa1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb790e34b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096585.283142:0:8109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4b400/0xa979d75fc166bfa1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096585.283166:0:8109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4b400/0xa979d75fc166bfa1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096585.283206:0:8109:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4bc00/0xa979d75fc166bf9a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096585.283211:0:8109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4bc00/0xa979d75fc166bf9a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096585.283215:0:8109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4bc00/0xa979d75fc166bf9a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096585.283220:0:8109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4bc00/0xa979d75fc166bf9a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096585.283223:0:8109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961845b4bc00 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:2.0:1787096585.283226:0:8109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4bc00/0xa979d75fc166bf9a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096585.283231:0:8109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4bc00/0xa979d75fc166bf9a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096585.283239:0:8109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9618472ca600) 00010000:00010000:2.0:1787096585.283242:0:8109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096585.283245:0:8109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4bc00/0xa979d75fc166bf9a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096585.283249:0:8109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4bc00/0xa979d75fc166bf9a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096585.283262:0:8109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4b400/0xa979d75fc166bfa1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096585.283272:0:8109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4b400/0xa979d75fc166bfa1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096585.283275:0:8109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4b400/0xa979d75fc166bfa1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096585.283278:0:8109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961845b4b400 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:2.0:1787096585.283280:0:8109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4b400/0xa979d75fc166bfa1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096585.283283:0:8109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4b400/0xa979d75fc166bfa1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096585.283289:0:8109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb790e34b (ffff961742a26700) 00010000:00010000:2.0:1787096585.283290:0:8109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096585.283291:0:8109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4b400/0xa979d75fc166bfa1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096585.283294:0:8109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4b400/0xa979d75fc166bfa1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096585.283332:0:8109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4b200/0xa979d75fc166bf93 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2064 expref: 7 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096585.283341:0:8109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9618472ca600) 00010000:00010000:2.0:1787096585.283344:0:8109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096585.283348:0:8109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4b200/0xa979d75fc166bf93 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2064 expref: 7 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096585.283357:0:8109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961845b4b200, rc 0) 00000100:00100000:2.0:1787096585.283434:0:8109:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742de8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70e19547-606a-4706-b016-3476e377d7df+6:34943:x1873906345505152:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 549us (685us total) trans 0 rc 301/301 00000100:00100000:2.0:1787096585.283491:0:8109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 183 00000100:00100000:3.0:1787096585.285420:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1787096585.285697:0:9989:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345505408 00000100:00100000:1.0:1787096585.285707:0:9989:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345505408 00000100:00100000:1.0:1787096585.285776:0:9989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 184 00000100:00100000:1.0:1787096585.285803:0:9989:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961848f9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:70e19547-606a-4706-b016-3476e377d7df+11:34943:x1873906345505408:12345-192.168.201.40@tcp:36:lfs.0 00000100:00100000:1.0:1787096585.285950:0:9989:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742db2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9989:1873906353975936:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1787096585.286017:0:9989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096585.286077:0:6494:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353975936 00000100:00100000:2.0:1787096585.286082:0:6494:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353975936 00000100:00100000:1.0:1787096585.286112:0:9989:0:(client.c:2692:ptlrpc_set_wait()) set ffff96187cad6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787096585.286137:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1787096585.286148:0:6494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742db0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:9989:x1873906353975936:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787096585.286242:0:6494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742db0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:9989:x1873906353975936:12345-0@lo:1000:mdt00_004.0 Request processed in 96us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096585.286251:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1787096585.286286:0:9989:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742db2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9989:1873906353975936:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1787096585.286345:0:9989:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742db2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9989:1873906353976064:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1787096585.286376:0:9989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096585.286399:0:9989:0:(client.c:2692:ptlrpc_set_wait()) set ffff96187cad6e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787096585.286428:0:6493:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353976064 00000100:00100000:3.0:1787096585.286434:0:6493:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353976064 00000100:00100000:3.0:1787096585.286489:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1787096585.286502:0:6493:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742db3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:9989:x1873906353976064:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787096585.286613:0:6493:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742db3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:9989:x1873906353976064:12345-0@lo:1000:mdt00_004.0 Request processed in 114us (235us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787096585.286622:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1787096585.286639:0:9989:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742db2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9989:1873906353976064:0@lo:1000:mdt00_004.0 00010000:00010000:1.0:1787096585.286688:0:9989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff96186ddf4200/0xa979d75fc166bfa8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.286700:0:9989:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff96186ddf4200/0xa979d75fc166bfa8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.286712:0:9989:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff96186ddf4200/0xa979d75fc166bfa8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096585.286725:0:9989:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742db2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9989:1873906353976192:0@lo:101:mdt00_004.0 00000100:00100000:1.0:1787096585.286749:0:9989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096585.286778:0:9989:0:(client.c:2692:ptlrpc_set_wait()) set ffff96187cad6cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787096585.286781:0:6494:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353976192 00000100:00100000:2.0:1787096585.286786:0:6494:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353976192 00000100:00100000:2.0:1787096585.286829:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1787096585.286838:0:6494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742db0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:9989:x1873906353976192:12345-0@lo:101:mdt00_004.0 00010000:00010000:2.0:1787096585.286848:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096585.286862:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4ac00/0xa979d75fc166bfaf lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa979d75fc166bfa8 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096585.286885:0:6494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4a600/0xa979d75fc166bf8c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b205d expref: 5 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096585.286895:0:6494:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4ac00/0xa979d75fc166bfaf lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xa979d75fc166bfa8 expref: 9 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096585.286919:0:6494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4a600/0xa979d75fc166bf8c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b205d expref: 5 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096585.286941:0:6494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4a600/0xa979d75fc166bf8c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b205d expref: 5 pid: 6489 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096585.286953:0:6494:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742de9500 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:6494:1873906353976320:192.168.201.40@tcp:104: 00000100:00100000:2.0:1787096585.287019:0:6494:0:(client.c:2692:ptlrpc_set_wait()) set ffff961742a35480 going to sleep for 11 seconds 00000100:00100000:1.0:1787096585.288051:0:6494:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742de9500 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:6494:1873906353976320:192.168.201.40@tcp:104: 00010000:00010000:1.0:1787096585.288073:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4ac00/0xa979d75fc166bfaf lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xa979d75fc166bfa8 expref: 9 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.288086:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9618472ca600) 00010000:00010000:1.0:1787096585.288095:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096585.288100:0:6494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4ac00/0xa979d75fc166bfaf lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xa979d75fc166bfa8 expref: 9 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.288109:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961845b4ac00, rc 0) 00000100:00100000:1.0:1787096585.288157:0:6494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742db0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:9989:x1873906353976192:12345-0@lo:101:mdt00_004.0 Request processed in 1321us (1407us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096585.288166:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1787096585.288189:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1787096585.288199:0:9989:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742db2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9989:1873906353976192:0@lo:101:mdt00_004.0 00010000:00010000:2.0:1787096585.288218:0:9989:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff96186ddf4200/0xa979d75fc166bfa8 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xa979d75fc166bfaf expref: -99 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096585.288222:0:7412:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345505536 00000100:00100000:1.0:1787096585.288228:0:7412:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345505536 00010000:00010000:2.0:1787096585.288231:0:9989:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff96186ddf4200/0xa979d75fc166bfa8 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa979d75fc166bfaf expref: -99 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.288256:0:7412:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4a600/0xa979d75fc166bf8c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b205d expref: 6 pid: 6489 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096585.288288:0:7412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 67 00000100:00100000:1.0:1787096585.288298:0:7412:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961848f99500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:70e19547-606a-4706-b016-3476e377d7df+6:2400:x1873906345505536:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787096585.288310:0:7412:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787096585.288317:0:7412:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4a600/0xa979d75fc166bf8c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b205d expref: 6 pid: 6489 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.288329:0:7412:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4a600/0xa979d75fc166bf8c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b205d expref: 6 pid: 6489 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.288350:0:7412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4a600/0xa979d75fc166bf8c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b205d expref: 6 pid: 6489 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.288362:0:7412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9618472ca600) 00010000:00010000:1.0:1787096585.288366:0:7412:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4ac00/0xa979d75fc166bfaf lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xa979d75fc166bfa8 expref: 8 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.288387:0:7412:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4ac00/0xa979d75fc166bfaf lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xa979d75fc166bfa8 expref: 8 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.288396:0:7412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4ac00/0xa979d75fc166bfaf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xa979d75fc166bfa8 expref: 8 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.288425:0:7412:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4ac00/0xa979d75fc166bfaf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xa979d75fc166bfa8 expref: 8 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096585.288437:0:7412:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742db0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:7412:1873906353976448:0@lo:105: 00000100:00100000:1.0:1787096585.288496:0:7412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096585.288535:0:7412:0:(client.c:2692:ptlrpc_set_wait()) set ffff96187cad6e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787096585.288553:0:8379:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353976448 00000100:00100000:1.0:1787096585.288557:0:8379:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353976448 00000100:00100000:1.0:1787096585.288598:0:8379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787096585.288605:0:8379:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742e5c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:7412:x1873906353976448:12345-0@lo:105: 00010000:00010000:1.0:1787096585.288617:0:8379:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff96186ddf4200/0xa979d75fc166bfa8 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa979d75fc166bfaf expref: -99 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.288627:0:8379:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff96186ddf4200/0xa979d75fc166bfa8 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa979d75fc166bfaf expref: -99 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.288636:0:8379:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff96186ddf4200/0xa979d75fc166bfa8 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xa979d75fc166bfaf expref: -99 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.288644:0:8379:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff96186ddf4200/0xa979d75fc166bfa8 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xa979d75fc166bfaf expref: -99 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.288663:0:8379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff96186ddf4200/0xa979d75fc166bfa8 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xa979d75fc166bfaf expref: -99 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.288673:0:8379:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff96186ddf4200/0xa979d75fc166bfa8 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xa979d75fc166bfaf expref: -99 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.288692:0:8379:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff96186ddf4200) 00010000:00010000:2.0:1787096585.288708:0:9989:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff96186ddf4200/0xa979d75fc166bfa8 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa979d75fc166bfaf expref: -99 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096585.288721:0:9989:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff96186ddf4200/0xa979d75fc166bfa8 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa979d75fc166bfaf expref: -99 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096585.288731:0:8379:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742e5c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:7412:x1873906353976448:12345-0@lo:105: Request processed in 125us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096585.288739:0:8379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000004:00080000:2.0:1787096585.288743:0:9989:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:3.0:1787096585.288773:0:7412:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742db0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:7412:1873906353976448:0@lo:105: 00010000:00010000:2.0:1787096585.288775:0:9989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4b200/0xa979d75fc166bfb6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096585.288789:0:9989:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4b200/0xa979d75fc166bfb6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096585.288797:0:7412:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787096585.288799:0:9989:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4b200/0xa979d75fc166bfb6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096585.288842:0:9989:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742de9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9989:1873906353976576:0@lo:101:mdt00_004.0 00000100:00100000:3.0:1787096585.288857:0:7412:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961848f99500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:70e19547-606a-4706-b016-3476e377d7df+5:2400:x1873906345505536:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 559us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096585.288867:0:7412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 67 00000100:00100000:2.0:1787096585.288875:0:9989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096585.288895:0:9989:0:(client.c:2692:ptlrpc_set_wait()) set ffff961742a35e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787096585.288911:0:6493:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353976576 00000100:00100000:2.0:1787096585.288915:0:6493:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353976576 00000100:00100000:2.0:1787096585.288944:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1787096585.288953:0:6493:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742dea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:9989:x1873906353976576:12345-0@lo:101:mdt00_004.0 00010000:00010000:2.0:1787096585.288966:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096585.288981:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4b400/0xa979d75fc166bfbd lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa979d75fc166bfb6 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096585.288999:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4b400/0xa979d75fc166bfbd lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xa979d75fc166bfb6 expref: 10 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096585.289010:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4b400/0xa979d75fc166bfbd lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xa979d75fc166bfb6 expref: 10 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096585.289017:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb790e34b (ffff961742a26000) 00010000:00010000:2.0:1787096585.289020:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096585.289023:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961845b4b400, rc 0) 00000100:00100000:2.0:1787096585.289060:0:6493:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742dea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:9989:x1873906353976576:12345-0@lo:101:mdt00_004.0 Request processed in 109us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096585.289067:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1787096585.289088:0:9989:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742de9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9989:1873906353976576:0@lo:101:mdt00_004.0 00010000:00010000:1.0:1787096585.289101:0:9989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4b200/0xa979d75fc166bfb6 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xa979d75fc166bfbd expref: -99 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.289111:0:9989:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4b200/0xa979d75fc166bfb6 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa979d75fc166bfbd expref: -99 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787096585.289124:0:9989:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:1.0:1787096585.289159:0:9989:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742c8f100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9989:1873906353976704:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1787096585.289188:0:9989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096585.289209:0:9989:0:(client.c:2692:ptlrpc_set_wait()) set ffff96187cad6780 going to sleep for 11 seconds 00000100:00100000:2.0:1787096585.289230:0:6494:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353976704 00000100:00100000:2.0:1787096585.289235:0:6494:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353976704 00000100:00100000:2.0:1787096585.289263:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1787096585.289279:0:6494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742c8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:9989:x1873906353976704:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787096585.289354:0:6494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742c8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:9989:x1873906353976704:12345-0@lo:1000:mdt00_004.0 Request processed in 83us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096585.289363:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1787096585.289372:0:9989:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742c8f100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9989:1873906353976704:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1787096585.289415:0:9989:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742c8f100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9989:1873906353976832:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1787096585.289502:0:9989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096585.289521:0:9989:0:(client.c:2692:ptlrpc_set_wait()) set ffff96187cad6780 going to sleep for 11 seconds 00000100:00100000:2.0:1787096585.289532:0:6493:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353976832 00000100:00100000:2.0:1787096585.289537:0:6493:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353976832 00000100:00100000:2.0:1787096585.289571:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1787096585.289580:0:6493:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742c8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:9989:x1873906353976832:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787096585.289666:0:6493:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742c8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:9989:x1873906353976832:12345-0@lo:1000:mdt00_004.0 Request processed in 87us (163us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787096585.289675:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1787096585.289679:0:9989:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742c8f100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9989:1873906353976832:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1787096585.289759:0:9989:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742c8f100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9989:1873906353976960:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1787096585.289782:0:9989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096585.289795:0:9989:0:(client.c:2692:ptlrpc_set_wait()) set ffff96187cad6780 going to sleep for 11 seconds 00000100:00100000:2.0:1787096585.289828:0:6494:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353976960 00000100:00100000:2.0:1787096585.289833:0:6494:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353976960 00000100:00100000:2.0:1787096585.289867:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1787096585.289876:0:6494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742c8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:9989:x1873906353976960:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787096585.289930:0:6494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742c8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:9989:x1873906353976960:12345-0@lo:1000:mdt00_004.0 Request processed in 55us (147us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787096585.289939:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1787096585.289947:0:9989:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742c8f100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9989:1873906353976960:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1787096585.289992:0:9989:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742c8f100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9989:1873906353977088:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1787096585.290014:0:9989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096585.290029:0:9989:0:(client.c:2692:ptlrpc_set_wait()) set ffff96187cad6780 going to sleep for 11 seconds 00000100:00100000:2.0:1787096585.290042:0:6493:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353977088 00000100:00100000:2.0:1787096585.290047:0:6493:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353977088 00000100:00100000:2.0:1787096585.290074:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1787096585.290082:0:6493:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742c8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:9989:x1873906353977088:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787096585.290140:0:6493:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742c8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:9989:x1873906353977088:12345-0@lo:1000:mdt00_004.0 Request processed in 59us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096585.290149:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1787096585.290159:0:9989:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742c8f100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9989:1873906353977088:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1787096585.290202:0:9989:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742c8f100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9989:1873906353977216:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1787096585.290220:0:9989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096585.290236:0:9989:0:(client.c:2692:ptlrpc_set_wait()) set ffff96187cad6780 going to sleep for 11 seconds 00000100:00100000:3.0:1787096585.290249:0:6494:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353977216 00000100:00100000:3.0:1787096585.290253:0:6494:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353977216 00000100:00100000:3.0:1787096585.290282:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1787096585.290291:0:6494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742c8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:9989:x1873906353977216:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787096585.290361:0:6494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742c8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:9989:x1873906353977216:12345-0@lo:1000:mdt00_004.0 Request processed in 72us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096585.290367:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1787096585.290378:0:9989:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742c8f100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9989:1873906353977216:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1787096585.290421:0:9989:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742c8f100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9989:1873906353977344:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1787096585.290467:0:9989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096585.290484:0:9989:0:(client.c:2692:ptlrpc_set_wait()) set ffff96187cad6780 going to sleep for 11 seconds 00000100:00100000:3.0:1787096585.290493:0:6493:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353977344 00000100:00100000:3.0:1787096585.290498:0:6493:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353977344 00000100:00100000:3.0:1787096585.290523:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1787096585.290528:0:6493:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742c8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:9989:x1873906353977344:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787096585.290579:0:6493:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742c8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:9989:x1873906353977344:12345-0@lo:1000:mdt00_004.0 Request processed in 50us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096585.290584:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1787096585.290590:0:9989:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742c8f100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9989:1873906353977344:0@lo:1000:mdt00_004.0 00000040:00080000:1.0:1787096585.291484:0:9989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].5, 2152 off41096 00000040:00080000:1.0:1787096585.291574:0:9989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].5, 2352 off41856 00000004:00080000:1.0:1787096585.291581:0:9989:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff96187cad6000 with version 8 00000004:00080000:0.0:1787096585.291608:0:7416:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff96184550da80 version 8 rpc_version 8 00000020:00100000:0.0:1787096585.291644:0:7416:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787096585.291654:0:7416:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff96187c8d7480 x1873906353977600/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787096585.291672:0:7416:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96187c8d7480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7416:1873906353977600:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787096585.291717:0:7416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096585.291737:0:7416:0:(client.c:2692:ptlrpc_set_wait()) set ffff9618757cb600 going to sleep for 11 seconds 00000100:00100000:3.0:1787096585.291753:0:6494:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353977600 00000100:00100000:3.0:1787096585.291758:0:6494:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353977600 00000100:00100000:3.0:1787096585.291806:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1787096585.291827:0:6494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96187c8d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:7416:x1873906353977600:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787096585.292349:0:6494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96187c8d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:7416:x1873906353977600:12345-0@lo:1000:osp_up0-1.0 Request processed in 536us (631us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1787096585.292355:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1787096585.292413:0:7416:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96187c8d7480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7416:1873906353977600:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1787096585.292538:0:9989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4e00/0xa979d75fc166bfc4 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.292553:0:9989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4e00/0xa979d75fc166bfc4 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.292575:0:9989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4e00/0xa979d75fc166bfc4 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.292591:0:9989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4000/0xa979d75fc166bfcb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.292596:0:9989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4000/0xa979d75fc166bfcb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.292601:0:9989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4000/0xa979d75fc166bfcb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.292627:0:9989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff96186ddf5000/0xa979d75fc166bfd2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.292633:0:9989:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff96186ddf5000/0xa979d75fc166bfd2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.292643:0:9989:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff96186ddf5000/0xa979d75fc166bfd2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096585.292657:0:9989:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742c8f100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9989:1873906353977728:0@lo:101:mdt00_004.0 00000100:00100000:1.0:1787096585.292692:0:9989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096585.292709:0:9989:0:(client.c:2692:ptlrpc_set_wait()) set ffff96187cad6cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787096585.292722:0:6493:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353977728 00000100:00100000:3.0:1787096585.292728:0:6493:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353977728 00000100:00100000:3.0:1787096585.292769:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1787096585.292778:0:6493:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961877975f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:9989:x1873906353977728:12345-0@lo:101:mdt00_004.0 00010000:00010000:3.0:1787096585.292792:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787096585.292807:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961840030c00/0xa979d75fc166bfd9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa979d75fc166bfd2 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096585.292839:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961840030c00/0xa979d75fc166bfd9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xa979d75fc166bfd2 expref: 12 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096585.292854:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961840030c00/0xa979d75fc166bfd9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xa979d75fc166bfd2 expref: 12 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096585.292864:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff96184a9ea200) 00010000:00010000:3.0:1787096585.292867:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096585.292871:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961840030c00, rc 0) 00000100:00100000:3.0:1787096585.292906:0:6493:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961877975f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+12:9989:x1873906353977728:12345-0@lo:101:mdt00_004.0 Request processed in 130us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096585.292912:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1787096585.292930:0:9989:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742c8f100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9989:1873906353977728:0@lo:101:mdt00_004.0 00010000:00010000:1.0:1787096585.292941:0:9989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff96186ddf5000/0xa979d75fc166bfd2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xa979d75fc166bfd9 expref: -99 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.292949:0:9989:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff96186ddf5000/0xa979d75fc166bfd2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa979d75fc166bfd9 expref: -99 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787096585.292975:0:9989:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000a63fd7b2 reply state 000000005211399c transno 4294967317 ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4000/0xa979d75fc166bfcb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.293000:0:9989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4000/0xa979d75fc166bfcb lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.293008:0:9989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x6:0x0].0x0 (ffff961742a1e200) 00010000:00010000:1.0:1787096585.293011:0:9989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787096585.293015:0:9989:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787096585.293023:0:9989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff96186ddf5000/0xa979d75fc166bfd2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xa979d75fc166bfd9 expref: -99 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.293032:0:9989:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff96186ddf5000/0xa979d75fc166bfd2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xa979d75fc166bfd9 expref: -99 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787096585.293041:0:9989:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000401:0x6:0x0] 00000004:00010000:1.0:1787096585.293054:0:9989:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000a63fd7b2 reply state 000000005211399c transno 4294967317 ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4e00/0xa979d75fc166bfc4 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.293063:0:9989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4e00/0xa979d75fc166bfc4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.293070:0:9989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x5:0x0].0x0 (ffff961742a1e300) 00010000:00010000:1.0:1787096585.293072:0:9989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787096585.293074:0:9989:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:1.0:1787096585.293081:0:9989:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000402:0x5:0x0]: returning size 4096 00000004:00080000:1.0:1787096585.293088:0:9989:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1787096585.293096:0:9989:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff96186ddf4200/0xa979d75fc166bfa8 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa979d75fc166bfaf expref: -99 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.293115:0:9989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff96186ddf4200/0xa979d75fc166bfa8 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xa979d75fc166bfaf expref: -99 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.293122:0:9989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff96186ddf4200/0xa979d75fc166bfa8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xa979d75fc166bfaf expref: -99 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.293149:0:9989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1787096585.293156:0:9989:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1787096585.293162:0:9989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4b200/0xa979d75fc166bfb6 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xa979d75fc166bfbd expref: -99 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.293170:0:9989:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4b200/0xa979d75fc166bfb6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xa979d75fc166bfbd expref: -99 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096585.293175:0:6476:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787096585.293184:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff96186ddf4200/0xa979d75fc166bfa8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xa979d75fc166bfaf expref: -99 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096585.293194:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96186ddf4200 already unused, calling callback (ffffffffc1765ee0) 00010000:00010000:3.0:1787096585.293200:0:6476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff96186ddf4200/0xa979d75fc166bfa8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xa979d75fc166bfaf expref: -99 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787096585.293207:0:6476:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff96186ddf4200/0xa979d75fc166bfa8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xa979d75fc166bfaf expref: -99 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096585.293241:0:6476:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff96186ddf4200/0xa979d75fc166bfa8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xa979d75fc166bfaf expref: -99 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096585.293247:0:6476:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787096585.293254:0:9989:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961848f9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:70e19547-606a-4706-b016-3476e377d7df+13:34943:x1873906345505408:12345-192.168.201.40@tcp:36:lfs.0 Request processed in 7467us (7839us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1787096585.293260:0:9989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 184 00010000:00010000:3.0:1787096585.293272:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff96186ddf4200/0xa979d75fc166bfa8 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xa979d75fc166bfaf expref: -99 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096585.293281:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff96186ddf4200/0xa979d75fc166bfa8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xa979d75fc166bfaf expref: -99 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096585.293294:0:6476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787096585.293297:0:6476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787096585.293299:0:6476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787096585.293309:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787096585.293321:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961848f9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1873906353977856:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787096585.293356:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096585.293396:0:6475:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353977856 00000100:00100000:1.0:1787096585.293402:0:6475:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353977856 00000100:00100000:1.0:1787096585.293515:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787096585.293525:0:6475:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961848f9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+12:3637:x1873906353977856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787096585.293536:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787096585.293554:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4ac00/0xa979d75fc166bfaf lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xa979d75fc166bfa8 expref: 12 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.293566:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9618472ca600) 00010000:00010000:1.0:1787096585.293576:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787096585.293613:0:6475:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961848f9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+11:3637:x1873906353977856:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096585.293621:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787096585.293751:0:3637:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961848f9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1873906353977856:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787096585.294615:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961877976680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1873906353977984:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787096585.294668:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096585.294716:0:6494:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353977984 00000100:00100000:1.0:1787096585.294721:0:6494:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353977984 00000100:00100000:1.0:1787096585.294760:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1787096585.294768:0:6494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961848f9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:3637:x1873906353977984:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787096585.294795:0:6494:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446215680 avail 1299976192 00000100:00100000:1.0:1787096585.294858:0:6494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961848f9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:3637:x1873906353977984:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096585.294867:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1787096585.294883:0:3637:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961877976680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1873906353977984:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787096585.305647:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1787096585.305699:0:6489:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345505664 00000100:00100000:1.0:1787096585.305713:0:6489:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345505664 00000100:00100000:1.0:1787096585.305786:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 185 00000100:00100000:1.0:1787096585.305800:0:6489:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96187c8d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70e19547-606a-4706-b016-3476e377d7df+5:34946:x1873906345505664:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1787096585.305846:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096585.305875:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4200/0xa979d75fc166bfe0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2ded7f867b206b expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.305963:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5e00/0xa979d75fc166bfe7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.305982:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5e00/0xa979d75fc166bfe7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.305997:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5e00/0xa979d75fc166bfe7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787096585.306069:0:6489:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787096585.306074:0:6489:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787096585.306100:0:6489:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5e00/0xa979d75fc166bfe7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.306131:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4200/0xa979d75fc166bfe0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b206b expref: 7 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.306147:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5e00/0xa979d75fc166bfe7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b206b expref: 6 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.306158:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9618472ca600) 00010000:00010000:1.0:1787096585.306162:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787096585.306167:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96186ddf5e00, rc 0) 00000100:00100000:1.0:1787096585.306248:0:6489:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96187c8d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70e19547-606a-4706-b016-3476e377d7df+6:34946:x1873906345505664:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 451us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096585.306256:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 185 00000100:00100000:0.0:1787096585.309226:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1787096585.309288:0:8109:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345505792 00000100:00100000:1.0:1787096585.309302:0:8109:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345505792 00000100:00100000:1.0:1787096585.313157:0:8109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 186 00000100:00100000:1.0:1787096585.313180:0:8109:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96187c8d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70e19547-606a-4706-b016-3476e377d7df+6:34946:x1873906345505792:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1787096585.313209:0:8109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096585.313233:0:8109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4400/0xa979d75fc166bfee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2ded7f867b2072 expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.313329:0:8109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5400/0xa979d75fc166bff5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.313355:0:8109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5400/0xa979d75fc166bff5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.313369:0:8109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5400/0xa979d75fc166bff5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.313382:0:8109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5a00/0xa979d75fc166bffc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb790e34b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.313394:0:8109:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4b400/0xa979d75fc166bfbd lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xa979d75fc166bfb6 expref: 10 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.313403:0:8109:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5a00/0xa979d75fc166bffc lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.313588:0:8109:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4b400/0xa979d75fc166bfbd lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xa979d75fc166bfb6 expref: 10 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096585.313610:0:8109:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961877976300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8109:1873906353978112:0@lo:104: 00000100:00100000:1.0:1787096585.313695:0:8109:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096585.313736:0:6471:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353978112 00000100:00100000:0.0:1787096585.313746:0:6471:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353978112 00000100:00100000:1.0:1787096585.313765:0:8109:0:(client.c:2692:ptlrpc_set_wait()) set ffff96187cad6d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787096585.313802:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787096585.313824:0:6471:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961877977100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:8109:x1873906353978112:12345-0@lo:104: 00010000:00010000:0.0:1787096585.313847:0:6471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4b200/0xa979d75fc166bfb6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xa979d75fc166bfbd expref: -99 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096585.313912:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787096585.313919:0:6471:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961877977100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:8109:x1873906353978112:12345-0@lo:104: Request processed in 110us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096585.313926:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00010000:0.0:1787096585.313963:0:7858:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787096585.313971:0:7858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4b200/0xa979d75fc166bfb6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xa979d75fc166bfbd expref: -99 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096585.313979:0:7858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961845b4b200 already unused, calling callback (ffffffffc1765ee0) 00010000:00010000:0.0:1787096585.313984:0:7858:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4b200/0xa979d75fc166bfb6 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xa979d75fc166bfbd expref: -99 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787096585.313994:0:7858:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4b200/0xa979d75fc166bfb6 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xa979d75fc166bfbd expref: -99 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096585.314026:0:8109:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961877976300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8109:1873906353978112:0@lo:104: 00010000:00010000:0.0:1787096585.314027:0:7858:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4b200/0xa979d75fc166bfb6 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xa979d75fc166bfbd expref: -99 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096585.314037:0:7858:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787096585.314049:0:8109:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5a00/0xa979d75fc166bffc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096585.314060:0:7858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4b200/0xa979d75fc166bfb6 lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xa979d75fc166bfbd expref: -99 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096585.314069:0:7858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4b200/0xa979d75fc166bfb6 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xa979d75fc166bfbd expref: -99 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096585.314086:0:7858:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787096585.314093:0:7858:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787096585.314094:0:7858:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787096585.314177:0:3634:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96187c8d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1873906353978240:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787096585.314222:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096585.314266:0:8380:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353978240 00000100:00100000:1.0:1787096585.314283:0:8380:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353978240 00010000:00010000:1.0:1787096585.314307:0:8380:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4b400/0xa979d75fc166bfbd lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xa979d75fc166bfb6 expref: 11 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096585.314357:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787096585.314367:0:8380:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9618589cb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+11:3634:x1873906353978240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787096585.314385:0:8380:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:3.0:1787096585.317273:0:6467:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967362 is committed 00010000:00010000:2.0:1787096585.317707:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4b400/0xa979d75fc166bfbd lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xa979d75fc166bfb6 expref: 9 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096585.317749:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb790e34b (ffff961742a26000) 00010000:00010000:2.0:1787096585.317756:0:8380:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5a00/0xa979d75fc166bffc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096585.317766:0:8380:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5a00/0xa979d75fc166bffc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096585.317775:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5a00/0xa979d75fc166bffc lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096585.317825:0:8380:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787096585.317932:0:8380:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9618589cb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+8:3634:x1873906353978240:12345-0@lo:103:ldlm_bl.0 Request processed in 3564us (3707us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096585.317945:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00010000:0.0:1787096585.318057:0:8109:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5a00/0xa979d75fc166bffc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096585.318068:0:8109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5a00/0xa979d75fc166bffc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096585.318224:0:3634:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96187c8d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1873906353978240:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787096585.318235:0:8109:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742fd1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8109:1873906353978368:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787096585.318284:0:8109:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096585.318315:0:8109:0:(client.c:2692:ptlrpc_set_wait()) set ffff9618757cb300 going to sleep for 11 seconds 00000100:00100000:3.0:1787096585.318408:0:6493:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353978368 00000100:00100000:3.0:1787096585.318420:0:6493:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353978368 00000100:00100000:3.0:1787096585.318515:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1787096585.318541:0:6493:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742fd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8109:x1873906353978368:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787096585.318668:0:6493:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742fd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8109:x1873906353978368:12345-0@lo:1000:mdt00_003.0 Request processed in 132us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096585.318675:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1787096585.318726:0:8109:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742fd1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8109:1873906353978368:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1787096585.318922:0:8109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e600/0xa979d75fc166c003 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096585.318936:0:8109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e600/0xa979d75fc166c003 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096585.318945:0:8109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e600/0xa979d75fc166c003 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787096585.318969:0:8109:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e600/0xa979d75fc166c003 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096585.318984:0:8109:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5400/0xa979d75fc166bff5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096585.318991:0:8109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5400/0xa979d75fc166bff5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096585.318997:0:8109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5400/0xa979d75fc166bff5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096585.319015:0:8109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5400/0xa979d75fc166bff5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096585.319021:0:8109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96186ddf5400 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:0.0:1787096585.319026:0:8109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5400/0xa979d75fc166bff5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096585.319216:0:8109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5400/0xa979d75fc166bff5 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096585.319228:0:8109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9618472ca600) 00010000:00010000:0.0:1787096585.319232:0:8109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096585.319237:0:8109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5400/0xa979d75fc166bff5 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096585.319244:0:8109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5400/0xa979d75fc166bff5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096585.319257:0:8109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5a00/0xa979d75fc166bffc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096585.319263:0:8109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5a00/0xa979d75fc166bffc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096585.319269:0:8109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5a00/0xa979d75fc166bffc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096585.319274:0:8109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96186ddf5a00 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:0.0:1787096585.319276:0:8109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5a00/0xa979d75fc166bffc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096585.319291:0:8109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5a00/0xa979d75fc166bffc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096585.319298:0:8109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb790e34b (ffff961742a26000) 00010000:00010000:0.0:1787096585.319300:0:8109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096585.319304:0:8109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5a00/0xa979d75fc166bffc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096585.319309:0:8109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5a00/0xa979d75fc166bffc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096585.319348:0:8109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4400/0xa979d75fc166bfee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2072 expref: 8 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096585.319360:0:8109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e600/0xa979d75fc166c003 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2072 expref: 7 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096585.319367:0:8109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x5:0x0].0x0 (ffff961741933300) 00010000:00010000:0.0:1787096585.319369:0:8109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787096585.319371:0:8109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96174340e600, rc 0) 00000100:00100000:0.0:1787096585.319428:0:8109:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96187c8d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70e19547-606a-4706-b016-3476e377d7df+7:34946:x1873906345505792:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 6257us (10213us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096585.319435:0:8109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 186 00000100:00100000:3.0:1787096585.320990:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1787096585.321057:0:9989:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345505920 00000100:00100000:1.0:1787096585.321069:0:9989:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345505920 00000100:00100000:1.0:1787096585.321131:0:9989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 187 00000100:00100000:1.0:1787096585.321143:0:9989:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961848f98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:70e19547-606a-4706-b016-3476e377d7df+13:34946:x1873906345505920:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1787096585.321175:0:9989:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096585.321196:0:9989:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4200/0xa979d75fc166c00a lrc: 2/0,0 mode: --/CR res: [0x240000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2ded7f867b2079 expref: -99 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.321261:0:9989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf5800/0xa979d75fc166c011 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.321275:0:9989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf5800/0xa979d75fc166c011 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.321287:0:9989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf5800/0xa979d75fc166c011 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787096585.321396:0:9989:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000402:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1787096585.321402:0:9989:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1787096585.321435:0:9989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4200/0xa979d75fc166c00a lrc: 0/0,0 mode: --/CR res: [0x240000402:0x5:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2079 expref: 15 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.321492:0:9989:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf5800/0xa979d75fc166c011 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2079 expref: 14 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.321517:0:9989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x5:0x0].0x0 (ffff961742a1e300) 00010000:00010000:1.0:1787096585.321520:0:9989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:1.0:1787096585.321523:0:9989:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96186ddf5800, rc 0) 00000100:00100000:1.0:1787096585.321576:0:9989:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961848f98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:70e19547-606a-4706-b016-3476e377d7df+14:34946:x1873906345505920:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 437us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096585.321583:0:9989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 187 00000100:00100000:0.0:1787096585.322635:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1787096585.322694:0:6488:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345506048 00000100:00100000:1.0:1787096585.322703:0:6488:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345506048 00000100:00100000:1.0:1787096585.322768:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 188 00000100:00100000:1.0:1787096585.322779:0:6488:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742fd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70e19547-606a-4706-b016-3476e377d7df+14:34946:x1873906345506048:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1787096585.322796:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096585.322811:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf5600/0xa979d75fc166c018 lrc: 2/0,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2ded7f867b2080 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.322866:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf5200/0xa979d75fc166c01f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.322878:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf5200/0xa979d75fc166c01f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.322887:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf5200/0xa979d75fc166c01f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787096585.322929:0:6488:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000400:0x6:0x0]: returning size 4096 00000004:00200000:1.0:1787096585.322934:0:6488:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1787096585.322957:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf5600/0xa979d75fc166c018 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2080 expref: 16 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.322994:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf5200/0xa979d75fc166c01f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2080 expref: 15 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.323004:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x6:0x0].0x0 (ffff961742a1e200) 00010000:00010000:1.0:1787096585.323007:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787096585.323010:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96186ddf5200, rc 0) 00000100:00100000:1.0:1787096585.323067:0:6488:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742fd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70e19547-606a-4706-b016-3476e377d7df+15:34946:x1873906345506048:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 280us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096585.323076:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 188 00000100:00100000:0.0:1787096585.324122:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1787096585.324170:0:8109:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345506176 00000100:00100000:1.0:1787096585.324178:0:8109:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345506176 00000100:00100000:1.0:1787096585.324214:0:8109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 189 00000100:00100000:1.0:1787096585.324221:0:8109:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742fd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70e19547-606a-4706-b016-3476e377d7df+7:34946:x1873906345506176:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1787096585.324233:0:8109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096585.324245:0:8109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5c00/0xa979d75fc166c026 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2ded7f867b2087 expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.324280:0:8109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4600/0xa979d75fc166c02d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.324290:0:8109:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961840030c00/0xa979d75fc166bfd9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xa979d75fc166bfd2 expref: 7 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.324296:0:8109:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4600/0xa979d75fc166c02d lrc: 4/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.324338:0:8109:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff961840030c00/0xa979d75fc166bfd9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xa979d75fc166bfd2 expref: 7 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096585.324368:0:8109:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961877976300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8109:1873906353978496:0@lo:104: 00000100:00100000:1.0:1787096585.324423:0:8109:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096585.324496:0:6472:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787096585.324518:0:6472:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353978496 00000100:00100000:2.0:1787096585.324522:0:6472:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353978496 00000100:00100000:1.0:1787096585.324556:0:8109:0:(client.c:2692:ptlrpc_set_wait()) set ffff96187cad6d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787096585.324580:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787096585.324593:0:6472:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742ecc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:8109:x1873906353978496:12345-0@lo:104: 00010000:00010000:2.0:1787096585.324607:0:6472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff96186ddf5000/0xa979d75fc166bfd2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xa979d75fc166bfd9 expref: -99 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096585.324690:0:6472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787096585.324699:0:6472:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742ecc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:8109:x1873906353978496:12345-0@lo:104: Request processed in 110us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096585.324705:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00010000:3.0:1787096585.324711:0:10297:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787096585.324719:0:10297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff96186ddf5000/0xa979d75fc166bfd2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xa979d75fc166bfd9 expref: -99 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096585.324729:0:10297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96186ddf5000 already unused, calling callback (ffffffffc1765ee0) 00000100:00100000:0.0:1787096585.324733:0:8109:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961877976300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8109:1873906353978496:0@lo:104: 00010000:00010000:3.0:1787096585.324736:0:10297:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff96186ddf5000/0xa979d75fc166bfd2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xa979d75fc166bfd9 expref: -99 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787096585.324746:0:10297:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff96186ddf5000/0xa979d75fc166bfd2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xa979d75fc166bfd9 expref: -99 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096585.324783:0:8109:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4600/0xa979d75fc166c02d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096585.324790:0:10297:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff96186ddf5000/0xa979d75fc166bfd2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xa979d75fc166bfd9 expref: -99 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096585.324807:0:10297:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787096585.324838:0:10297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff96186ddf5000/0xa979d75fc166bfd2 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xa979d75fc166bfd9 expref: -99 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096585.324843:0:10297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff96186ddf5000/0xa979d75fc166bfd2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xa979d75fc166bfd9 expref: -99 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096585.324860:0:10297:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787096585.324861:0:3635:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961848f98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1873906353978624:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787096585.324864:0:10297:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787096585.324877:0:10297:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787096585.324897:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096585.324925:0:7412:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353978624 00000100:00100000:3.0:1787096585.324931:0:7412:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353978624 00010000:00010000:3.0:1787096585.324954:0:7412:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff961840030c00/0xa979d75fc166bfd9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xa979d75fc166bfd2 expref: 8 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096585.324986:0:7412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787096585.324996:0:7412:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742deb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+8:3635:x1873906353978624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787096585.325008:0:7412:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787096585.325400:0:7412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961840030c00/0xa979d75fc166bfd9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xa979d75fc166bfd2 expref: 8 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096585.325411:0:7412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff96184a9ea200) 00010000:00010000:3.0:1787096585.325419:0:7412:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4600/0xa979d75fc166c02d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096585.325426:0:7412:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4600/0xa979d75fc166c02d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096585.325431:0:7412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4600/0xa979d75fc166c02d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096585.325471:0:7412:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787096585.325509:0:8109:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4600/0xa979d75fc166c02d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096585.325520:0:8109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4600/0xa979d75fc166c02d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096585.325562:0:7412:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742deb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+7:3635:x1873906353978624:12345-0@lo:103:ldlm_bl.0 Request processed in 564us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096585.325570:0:7412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000004:00200000:0.0:1787096585.325579:0:8109:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x6:0x0]: returning size 4096 00000100:00100000:3.0:1787096585.325585:0:3635:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961848f98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1873906353978624:0@lo:103:ldlm_bl.0 00000004:00200000:0.0:1787096585.325587:0:8109:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1787096585.325631:0:8109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5c00/0xa979d75fc166c026 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2087 expref: 9 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096585.325647:0:8109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4600/0xa979d75fc166c02d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2087 expref: 8 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096585.325655:0:8109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff96184a9ea200) 00010000:00010000:0.0:1787096585.325658:0:8109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787096585.325660:0:8109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96186ddf4600, rc 0) 00000100:00100000:0.0:1787096585.325709:0:8109:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742fd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70e19547-606a-4706-b016-3476e377d7df+8:34946:x1873906345506176:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1487us (1589us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096585.325718:0:8109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 189 00000100:00100000:3.0:1787096585.326911:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1787096585.326957:0:9989:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345506304 00000100:00100000:1.0:1787096585.326968:0:9989:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345506304 00000100:00100000:1.0:1787096585.327025:0:9989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 190 00000100:00100000:1.0:1787096585.327033:0:9989:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961848f98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:70e19547-606a-4706-b016-3476e377d7df+15:34946:x1873906345506304:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1787096585.327052:0:9989:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096585.327073:0:9989:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4a00/0xa979d75fc166c034 lrc: 2/0,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2ded7f867b208e expref: -99 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.327128:0:9989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4800/0xa979d75fc166c03b lrc: 3/1,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.327140:0:9989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4800/0xa979d75fc166c03b lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.327151:0:9989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4800/0xa979d75fc166c03b lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.327259:0:9989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4c00/0xa979d75fc166c042 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.327273:0:9989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4c00/0xa979d75fc166c042 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.327282:0:9989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4c00/0xa979d75fc166c042 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.327336:0:9989:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4800/0xa979d75fc166c03b lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.327345:0:9989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4800/0xa979d75fc166c03b lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.327352:0:9989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4800/0xa979d75fc166c03b lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.327359:0:9989:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4800/0xa979d75fc166c03b lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.327365:0:9989:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96186ddf4800 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:1.0:1787096585.327368:0:9989:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4800/0xa979d75fc166c03b lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.327373:0:9989:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4800/0xa979d75fc166c03b lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.327379:0:9989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x6:0x0].0x0 (ffff961742a1e200) 00010000:00010000:1.0:1787096585.327381:0:9989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096585.327383:0:9989:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4800/0xa979d75fc166c03b lrc: 3/0,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.327387:0:9989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4800/0xa979d75fc166c03b lrc: 0/0,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.327395:0:9989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4c00/0xa979d75fc166c042 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.327399:0:9989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4c00/0xa979d75fc166c042 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.327406:0:9989:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4c00/0xa979d75fc166c042 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.327409:0:9989:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96186ddf4c00 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:1.0:1787096585.327411:0:9989:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4c00/0xa979d75fc166c042 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.327414:0:9989:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4c00/0xa979d75fc166c042 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.327418:0:9989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x6:0x0].0xdd5a5043 (ffff961742a1e000) 00010000:00010000:1.0:1787096585.327419:0:9989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096585.327421:0:9989:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4c00/0xa979d75fc166c042 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.327424:0:9989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4c00/0xa979d75fc166c042 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.327484:0:9989:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4a00/0xa979d75fc166c034 lrc: 1/0,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b208e expref: 16 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.327494:0:9989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x6:0x0].0x0 (ffff961742a1e200) 00010000:00010000:1.0:1787096585.327496:0:9989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096585.327499:0:9989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4a00/0xa979d75fc166c034 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b208e expref: 16 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.327506:0:9989:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96186ddf4a00, rc 0) 00000100:00100000:1.0:1787096585.327539:0:9989:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961848f98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:70e19547-606a-4706-b016-3476e377d7df+15:34946:x1873906345506304:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 507us (629us total) trans 0 rc 301/301 00000100:00100000:1.0:1787096585.327550:0:9989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 190 00000100:00100000:3.0:1787096585.328772:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1787096585.328843:0:6488:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345506560 00000100:00100000:1.0:1787096585.328849:0:6488:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345506560 00000100:00100000:1.0:1787096585.328881:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 191 00000100:00100000:1.0:1787096585.328887:0:6488:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961848f99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70e19547-606a-4706-b016-3476e377d7df+15:34946:x1873906345506560:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1787096585.328901:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096585.328903:0:6488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787096585.328911:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf5200/0xa979d75fc166c01f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2080 expref: 15 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.328919:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x6:0x0].0x0 (ffff961742a1e200) 00010000:00010000:1.0:1787096585.328921:0:6488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787096585.328928:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf5600/0xa979d75fc166c049 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2ded7f867b2095 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.328978:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4200/0xa979d75fc166c050 lrc: 3/0,1 mode: --/CW res: [0x240000400:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.328985:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4200/0xa979d75fc166c050 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.328989:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4200/0xa979d75fc166c050 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.328996:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4400/0xa979d75fc166c057 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.329000:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4400/0xa979d75fc166c057 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.329012:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4400/0xa979d75fc166c057 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096585.329102:0:6488:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961877976300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6488:1873906353978752:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787096585.329144:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096585.329180:0:6488:0:(client.c:2692:ptlrpc_set_wait()) set ffff96187cad6d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787096585.329206:0:6494:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353978752 00000100:00100000:3.0:1787096585.329214:0:6494:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353978752 00000100:00100000:3.0:1787096585.329262:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1787096585.329277:0:6494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961877977100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:6488:x1873906353978752:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787096585.329388:0:6494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961877977100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:6488:x1873906353978752:12345-0@lo:1000:mdt00_000.0 Request processed in 116us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096585.329400:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1787096585.329416:0:6488:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967362 gen 2 00000004:00080000:1.0:1787096585.329420:0:6488:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967361 committed transno 4294967362 00000004:00080000:1.0:1787096585.329508:0:6488:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967362 committed transno 4294967362 00000100:00100000:1.0:1787096585.329526:0:6488:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961877976300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6488:1873906353978752:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1787096585.329842:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e000/0xa979d75fc166c05e lrc: 3/1,0 mode: --/PR res: [0x240000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096585.329854:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e000/0xa979d75fc166c05e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096585.329863:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e000/0xa979d75fc166c05e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787096585.329885:0:6488:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000402:0x6:0x0]: returning size 0 00010000:00010000:0.0:1787096585.329906:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4200/0xa979d75fc166c050 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096585.329913:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4200/0xa979d75fc166c050 lrc: 2/0,0 mode: CW/CW res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096585.329917:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4200/0xa979d75fc166c050 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096585.329921:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96186ddf4200 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:0.0:1787096585.329923:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4200/0xa979d75fc166c050 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096585.329928:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4200/0xa979d75fc166c050 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096585.329934:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x6:0x0].0x0 (ffff961742a1e200) 00010000:00010000:0.0:1787096585.329936:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096585.329938:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4200/0xa979d75fc166c050 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096585.329941:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4200/0xa979d75fc166c050 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787096585.329948:0:6488:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000a93f41e2 reply state 000000002abb0c1a transno 4294967318 ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4400/0xa979d75fc166c057 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096585.329955:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4400/0xa979d75fc166c057 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096585.329969:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x6:0x0].0xdd5a5043 (ffff961742a1e700) 00010000:00010000:0.0:1787096585.329972:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787096585.329974:0:6488:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787096585.329997:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf5600/0xa979d75fc166c049 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2095 expref: 17 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096585.330011:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e000/0xa979d75fc166c05e lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2095 expref: 16 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096585.330017:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x0 (ffff961741933800) 00010000:00010000:0.0:1787096585.330020:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787096585.330022:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96174340e000, rc 0) 00000100:00100000:0.0:1787096585.330063:0:6488:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961848f99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70e19547-606a-4706-b016-3476e377d7df+17:34946:x1873906345506560:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1175us (1294us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1787096585.330071:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 191 00000100:00100000:2.0:1787096585.333481:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1787096585.333628:0:8109:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345506816 00000100:00100000:0.0:1787096585.333637:0:8109:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345506816 00000100:00100000:0.0:1787096585.333677:0:8109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 192 00000100:00100000:0.0:1787096585.333683:0:8109:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742de9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70e19547-606a-4706-b016-3476e377d7df+17:34946:x1873906345506816:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1787096585.333698:0:8109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787096585.333711:0:8109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e400/0xa979d75fc166c06c lrc: 2/0,0 mode: --/CR res: [0x240000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2ded7f867b209c expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096585.333790:0:8109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e800/0xa979d75fc166c073 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096585.333804:0:8109:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e000/0xa979d75fc166c05e lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2095 expref: 18 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096585.333829:0:8109:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e800/0xa979d75fc166c073 lrc: 4/0,1 mode: --/EX res: [0x240000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096585.333854:0:8109:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e000/0xa979d75fc166c05e lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2095 expref: 18 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096585.333863:0:8109:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e000/0xa979d75fc166c05e lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2095 expref: 18 pid: 6488 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096585.333879:0:8109:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742fd1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8109:1873906353978880:192.168.201.40@tcp:104: 00000100:00100000:0.0:1787096585.333961:0:8109:0:(client.c:2692:ptlrpc_set_wait()) set ffff9618757cb540 going to sleep for 11 seconds 00000100:00100000:0.0:1787096585.335081:0:8109:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742fd1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8109:1873906353978880:192.168.201.40@tcp:104: 00010000:00010000:0.0:1787096585.335100:0:8109:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e800/0xa979d75fc166c073 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096585.336650:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1787096585.339921:0:6473:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345506944 00000100:00100000:0.0:1787096585.339941:0:6473:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345506944 00010000:00010000:0.0:1787096585.339986:0:6473:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e000/0xa979d75fc166c05e lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2095 expref: 19 pid: 6488 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096585.340030:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 70 00000100:00100000:0.0:1787096585.340040:0:6473:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742de9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:70e19547-606a-4706-b016-3476e377d7df+19:2400:x1873906345506944:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787096585.340058:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787096585.340064:0:6473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e000/0xa979d75fc166c05e lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2095 expref: 19 pid: 6488 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096585.340096:0:6473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e000/0xa979d75fc166c05e lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2095 expref: 19 pid: 6488 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096585.340116:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e000/0xa979d75fc166c05e lrc: 0/0,0 mode: --/PR res: [0x240000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2095 expref: 19 pid: 6488 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096585.340130:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x0 (ffff961741933800) 00010000:00010000:0.0:1787096585.340135:0:6473:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e800/0xa979d75fc166c073 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096585.340143:0:6473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e800/0xa979d75fc166c073 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096585.340150:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e800/0xa979d75fc166c073 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096585.340180:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787096585.340222:0:8109:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e800/0xa979d75fc166c073 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.340232:0:8109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e800/0xa979d75fc166c073 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096585.340241:0:6473:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742de9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:70e19547-606a-4706-b016-3476e377d7df+18:2400:x1873906345506944:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 200us (3601us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096585.340249:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 70 00000004:00200000:1.0:1787096585.340256:0:8109:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000402:0x6:0x0]: returning size 0 00010000:00010000:1.0:1787096585.340407:0:8109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e800/0xa979d75fc166c073 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.340416:0:8109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e800/0xa979d75fc166c073 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.340423:0:8109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e800/0xa979d75fc166c073 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.340430:0:8109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96174340e800 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:1.0:1787096585.340435:0:8109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e800/0xa979d75fc166c073 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.340477:0:8109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e800/0xa979d75fc166c073 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.340488:0:8109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x0 (ffff961741933800) 00010000:00010000:1.0:1787096585.340491:0:8109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787096585.340494:0:8109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e800/0xa979d75fc166c073 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.340501:0:8109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e800/0xa979d75fc166c073 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.340538:0:8109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e400/0xa979d75fc166c06c lrc: 1/0,0 mode: --/CR res: [0x240000402:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b209c expref: 17 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.340549:0:8109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x0 (ffff961741933800) 00010000:00010000:1.0:1787096585.340551:0:8109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787096585.340555:0:8109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e400/0xa979d75fc166c06c lrc: 0/0,0 mode: --/CR res: [0x240000402:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b209c expref: 17 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096585.340570:0:8109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96174340e400, rc 0) 00000100:00100000:1.0:1787096585.340608:0:8109:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742de9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70e19547-606a-4706-b016-3476e377d7df+16:34946:x1873906345506816:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 6924us (7177us total) trans 0 rc 301/301 00000100:00100000:1.0:1787096585.340615:0:8109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 192 00000100:00100000:0.0:1787096585.342653:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1787096585.342709:0:6492:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345507200 00000100:00100000:3.0:1787096585.342723:0:6492:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345507200 00000100:00100000:3.0:1787096585.342784:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 31 00000100:00100000:3.0:1787096585.342796:0:6492:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70e19547-606a-4706-b016-3476e377d7df+16:34946:x1873906345507200:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:3.0:1787096585.343085:0:6492:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70e19547-606a-4706-b016-3476e377d7df+17:34946:x1873906345507200:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 291us (435us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1787096585.343094:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 31 00010000:00010000:3.0:1787096585.486629:0:6477:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787096585.942857:0:22322:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-ec test_23c: @@@@@@ FAIL: setstripe failed 00010000:00010000:3.0:1787096586.511527:0:6476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 1574 lines, 1574 kept, 0 dropped, 0 bad.