00010000:00010000:1.0F:1787096279.728571:0:6465:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0F:1787096280.006105:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1787096280.006192:0:6478:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077062400 00000100:00100000:1.0:1787096280.006202:0:6478:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077062400 00000100:00100000:1.0:1787096280.006263:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 174 00000100:00100000:1.0:1787096280.006273:0:6478:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abd60c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9858421-28a9-4744-99eb-72e5bedc52c4+18:34754:x1873906077062400:12345-192.168.201.52@tcp:101:rm.0 00010000:00010000:1.0:1787096280.006295:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096280.006314:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7983881200/0x9eebb2eb7f50d901 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ef7bc65b7b4113f expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0F:1787096280.006623:0:6473:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1787096280.006677:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7983881e00/0x9eebb2eb7f50d908 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.006691:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c7983881e00/0x9eebb2eb7f50d908 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.006704:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7983881e00/0x9eebb2eb7f50d908 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787096280.006778:0:6478:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000402:0x2:0x0]: returning size 4096 00000004:00200000:1.0:1787096280.006782:0:6478:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:1.0:1787096280.006798:0:6478:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8c7983881e00/0x9eebb2eb7f50d908 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.006819:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7983881200/0x9eebb2eb7f50d901 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b4113f expref: 20 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.006849:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7983881e00/0x9eebb2eb7f50d908 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b4113f expref: 19 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.006856:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x2:0x0].0x0 (ffff8c7aadca5400) 00010000:00010000:1.0:1787096280.006861:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787096280.006871:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7983881e00, rc 0) 00000100:00100000:1.0:1787096280.006932:0:6478:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abd60c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9858421-28a9-4744-99eb-72e5bedc52c4+19:34754:x1873906077062400:12345-192.168.201.52@tcp:101:rm.0 Request processed in 662us (834us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096280.006938:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 174 00000100:00100000:3.0F:1787096280.007861:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1787096280.007919:0:6477:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077062528 00000100:00100000:2.0:1787096280.007924:0:6477:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077062528 00000100:00100000:2.0:1787096280.007961:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 175 00000100:00100000:2.0:1787096280.007971:0:6477:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7982f53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9858421-28a9-4744-99eb-72e5bedc52c4+19:34754:x1873906077062528:12345-192.168.201.52@tcp:101:rm.0 00010000:00010000:2.0:1787096280.007978:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096280.007987:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a89766600/0x9eebb2eb7f50d90f lrc: 2/0,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ef7bc65b7b41146 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.008018:0:6477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a89766c00/0x9eebb2eb7f50d916 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.008025:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a89766c00/0x9eebb2eb7f50d916 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.008032:0:6477:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a89766c00/0x9eebb2eb7f50d916 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787096280.008050:0:6477:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000400:0x5:0x0]: returning size 4096 00000004:00200000:2.0:1787096280.008053:0:6477:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1787096280.008071:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a89766600/0x9eebb2eb7f50d90f lrc: 0/0,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41146 expref: 21 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.008082:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a89766c00/0x9eebb2eb7f50d916 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41146 expref: 20 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.008088:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0x0 (ffff8c7aadca5600) 00010000:00010000:2.0:1787096280.008090:0:6477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787096280.008092:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7a89766c00, rc 0) 00000100:00100000:2.0:1787096280.008123:0:6477:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7982f53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9858421-28a9-4744-99eb-72e5bedc52c4+20:34754:x1873906077062528:12345-192.168.201.52@tcp:101:rm.0 Request processed in 156us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096280.008138:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 175 00000100:00100000:3.0:1787096280.009089:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1787096280.009142:0:6476:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077062784 00000100:00100000:2.0:1787096280.009146:0:6476:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077062784 00000100:00100000:2.0:1787096280.009175:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 176 00000100:00100000:2.0:1787096280.009180:0:6476:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7982f50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9858421-28a9-4744-99eb-72e5bedc52c4+20:34754:x1873906077062784:12345-192.168.201.52@tcp:101:rm.0 00010000:00010000:2.0:1787096280.009188:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096280.009196:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a89767e00/0x9eebb2eb7f50d91d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ef7bc65b7b4114d expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787096280.009258:0:6476:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000402:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1787096280.009326:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a89767e00/0x9eebb2eb7f50d91d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b4114d expref: 22 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.009335:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c7aadca8400) 00010000:00010000:2.0:1787096280.009337:0:6476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787096280.009340:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a89767e00/0x9eebb2eb7f50d91d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b4114d expref: 22 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.009349:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7a89767e00, rc 0) 00000100:00100000:2.0:1787096280.009399:0:6476:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7982f50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9858421-28a9-4744-99eb-72e5bedc52c4+21:34754:x1873906077062784:12345-192.168.201.52@tcp:101:rm.0 Request processed in 218us (312us total) trans 4294967308 rc 301/301 00000100:00100000:2.0:1787096280.009406:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 176 00000100:00100000:3.0:1787096280.010993:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1787096280.011035:0:14257:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077062912 00000100:00100000:1.0:1787096280.011040:0:14257:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077062912 00000100:00100000:1.0:1787096280.011088:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 27 00000100:00100000:1.0:1787096280.011095:0:14257:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7aac34f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f9858421-28a9-4744-99eb-72e5bedc52c4+21:34754:x1873906077062912:12345-192.168.201.52@tcp:37:rm.0 00000100:00100000:1.0:1787096280.013052:0:14257:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7aac34f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f9858421-28a9-4744-99eb-72e5bedc52c4+21:34754:x1873906077062912:12345-192.168.201.52@tcp:37:rm.0 Request processed in 1957us (2058us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096280.013058:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 27 00000100:00100000:1.0:1787096280.015219:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1787096280.015257:0:6479:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077063040 00000100:00100000:3.0:1787096280.015262:0:6479:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077063040 00000100:00100000:3.0:1787096280.015311:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 28 00000100:00080000:2.0:1787096280.015319:0:6473:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787096280.015323:0:6479:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983a6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9858421-28a9-4744-99eb-72e5bedc52c4+8:34754:x1873906077063040:12345-192.168.201.52@tcp:37:rm.0 00000100:00100000:1.0:1787096280.017424:0:6479:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983a6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9858421-28a9-4744-99eb-72e5bedc52c4+8:34754:x1873906077063040:12345-192.168.201.52@tcp:37:rm.0 Request processed in 2102us (2201us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096280.017431:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 28 00000100:00100000:2.0:1787096280.018906:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1787096280.018990:0:14257:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077063296 00000100:00100000:1.0:1787096280.018996:0:14257:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077063296 00000100:00100000:1.0:1787096280.019042:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 29 00000100:00100000:1.0:1787096280.019052:0:14257:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abd60ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f9858421-28a9-4744-99eb-72e5bedc52c4+21:34754:x1873906077063296:12345-192.168.201.52@tcp:35:rm.0 00000100:00100000:1.0:1787096280.019158:0:14257:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abd60ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f9858421-28a9-4744-99eb-72e5bedc52c4+22:34754:x1873906077063296:12345-192.168.201.52@tcp:35:rm.0 Request processed in 108us (253us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1787096280.019165:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 29 00000100:00100000:3.0:1787096280.020049:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1787096280.020112:0:21727:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077063552 00000100:00100000:0.0:1787096280.020121:0:21727:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077063552 00000100:00100000:0.0:1787096280.020173:0:21727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 177 00000100:00100000:0.0:1787096280.020183:0:21727:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7982f51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f9858421-28a9-4744-99eb-72e5bedc52c4+22:34754:x1873906077063552:12345-192.168.201.52@tcp:101:rm.0 00010000:00010000:0.0:1787096280.020203:0:21727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787096280.020222:0:21727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd762000/0x9eebb2eb7f50d92b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ef7bc65b7b41154 expref: -99 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.020348:0:21727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd762200/0x9eebb2eb7f50d932 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.020397:0:21727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd762200/0x9eebb2eb7f50d932 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.020409:0:21727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd762200/0x9eebb2eb7f50d932 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21727 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787096280.020419:0:21727:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000402:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1787096280.020559:0:21727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd762000/0x9eebb2eb7f50d92b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41154 expref: 25 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.020579:0:21727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd762200/0x9eebb2eb7f50d932 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41154 expref: 24 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.020586:0:21727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x2:0x0].0x0 (ffff8c7aadca5400) 00010000:00010000:0.0:1787096280.020589:0:21727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787096280.020591:0:21727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7abd762200, rc 0) 00000100:00100000:0.0:1787096280.020651:0:21727:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7982f51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f9858421-28a9-4744-99eb-72e5bedc52c4+24:34754:x1873906077063552:12345-192.168.201.52@tcp:101:rm.0 Request processed in 468us (602us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1787096280.020666:0:21727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 177 00000100:00100000:2.0:1787096280.021832:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1787096280.021866:0:8384:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077063680 00000100:00100000:3.0:1787096280.021872:0:8384:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077063680 00000100:00100000:3.0:1787096280.021905:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 178 00000100:00100000:3.0:1787096280.021912:0:8384:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a883f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9858421-28a9-4744-99eb-72e5bedc52c4+8:34754:x1873906077063680:12345-192.168.201.52@tcp:41:rm.0 00000004:00000024:3.0:1787096280.021954:0:8384:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 7847059456 avail 7384014848 00000100:00100000:3.0:1787096280.021994:0:8384:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a883f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9858421-28a9-4744-99eb-72e5bedc52c4+8:34754:x1873906077063680:12345-192.168.201.52@tcp:41:rm.0 Request processed in 83us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096280.022000:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 178 00000100:00100000:2.0:1787096280.023017:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1787096280.023041:0:10275:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077063808 00000100:00100000:3.0:1787096280.023046:0:10275:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077063808 00000100:00100000:3.0:1787096280.023084:0:10275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 179 00000100:00100000:3.0:1787096280.023093:0:10275:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a879f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9858421-28a9-4744-99eb-72e5bedc52c4+24:34754:x1873906077063808:12345-192.168.201.52@tcp:101:rm.0 00010000:00010000:3.0:1787096280.023104:0:10275:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787096280.023122:0:10275:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a869c9e00/0x9eebb2eb7f50d940 lrc: 2/0,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ef7bc65b7b4115b expref: -99 pid: 10275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096280.023154:0:10275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a869c9800/0x9eebb2eb7f50d947 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096280.023163:0:10275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a869c9800/0x9eebb2eb7f50d947 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096280.023176:0:10275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a869c9800/0x9eebb2eb7f50d947 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096280.023189:0:10275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a869c9400/0x9eebb2eb7f50d94e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0xae2548a7 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096280.023195:0:10275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a869c9400/0x9eebb2eb7f50d94e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0xae2548a7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096280.023200:0:10275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a869c9400/0x9eebb2eb7f50d94e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0xae2548a7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096280.023254:0:10275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a869c9a00/0x9eebb2eb7f50d955 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096280.023262:0:10275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a869c9a00/0x9eebb2eb7f50d955 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096280.023269:0:10275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a869c9a00/0x9eebb2eb7f50d955 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787096280.023300:0:10275:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000402:0x3:0x0]: returning size 0 00000004:00200000:3.0:1787096280.023304:0:10275:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787096280.023319:0:10275:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a869c9a00/0x9eebb2eb7f50d955 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096280.023327:0:10275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a869c9a00/0x9eebb2eb7f50d955 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096280.023336:0:10275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a869c9800/0x9eebb2eb7f50d947 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096280.023389:0:10275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a869c9800/0x9eebb2eb7f50d947 lrc: 2/0,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096280.023395:0:10275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a869c9800/0x9eebb2eb7f50d947 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096280.023400:0:10275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7a869c9800 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:3.0:1787096280.023404:0:10275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a869c9800/0x9eebb2eb7f50d947 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096280.023410:0:10275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a869c9800/0x9eebb2eb7f50d947 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096280.023419:0:10275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0x0 (ffff8c7aadca5600) 00010000:00010000:3.0:1787096280.023422:0:10275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096280.023425:0:10275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a869c9800/0x9eebb2eb7f50d947 lrc: 2/0,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096280.023441:0:10275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a869c9800/0x9eebb2eb7f50d947 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096280.023449:0:10275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a869c9400/0x9eebb2eb7f50d94e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0xae2548a7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096280.023453:0:10275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a869c9400/0x9eebb2eb7f50d94e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0xae2548a7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096280.023457:0:10275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a869c9400/0x9eebb2eb7f50d94e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0xae2548a7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096280.023461:0:10275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7a869c9400 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:3.0:1787096280.023470:0:10275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a869c9400/0x9eebb2eb7f50d94e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0xae2548a7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096280.023489:0:10275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a869c9400/0x9eebb2eb7f50d94e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0xae2548a7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096280.023496:0:10275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0xae2548a7 (ffff8c7aadca8e00) 00010000:00010000:3.0:1787096280.023497:0:10275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096280.023500:0:10275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a869c9400/0x9eebb2eb7f50d94e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0xae2548a7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096280.023505:0:10275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a869c9400/0x9eebb2eb7f50d94e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0xae2548a7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096280.023538:0:10275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a869c9e00/0x9eebb2eb7f50d940 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b4115b expref: 26 pid: 10275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096280.023547:0:10275:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a869c9a00/0x9eebb2eb7f50d955 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b4115b expref: 25 pid: 10275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096280.023553:0:10275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3:0x0].0x0 (ffff8c7aadca5700) 00010000:00010000:3.0:1787096280.023555:0:10275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787096280.023557:0:10275:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7a869c9a00, rc 0) 00000100:00100000:3.0:1787096280.023586:0:10275:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a879f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9858421-28a9-4744-99eb-72e5bedc52c4+25:34754:x1873906077063808:12345-192.168.201.52@tcp:101:rm.0 Request processed in 495us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096280.023592:0:10275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 179 00000100:00100000:0.0:1787096280.024677:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1787096280.024722:0:6478:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077064064 00000100:00100000:2.0:1787096280.024733:0:6478:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077064064 00000100:00100000:2.0:1787096280.024763:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 180 00000100:00100000:2.0:1787096280.024772:0:6478:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983920000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9858421-28a9-4744-99eb-72e5bedc52c4+25:34754:x1873906077064064:12345-192.168.201.52@tcp:36:rm.0 00010000:00010000:2.0:1787096280.024797:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1787096280.024809:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a869c9a00/0x9eebb2eb7f50d955 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b4115b expref: 25 pid: 10275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.024821:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3:0x0].0x0 (ffff8c7aadca5700) 00010000:00010000:2.0:1787096280.024832:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a89766c00/0x9eebb2eb7f50d916 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41146 expref: 24 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.024839:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0x0 (ffff8c7aadca5600) 00010000:00010000:2.0:1787096280.024841:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787096280.024850:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a89766000/0x9eebb2eb7f50d95c lrc: 3/0,1 mode: --/CW res: [0x240000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.024856:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a89766000/0x9eebb2eb7f50d95c lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.024862:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a89766000/0x9eebb2eb7f50d95c lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.024868:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a89767c00/0x9eebb2eb7f50d963 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0xae2548a7 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.024873:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a89767c00/0x9eebb2eb7f50d963 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0xae2548a7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.024877:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a89767c00/0x9eebb2eb7f50d963 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0xae2548a7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.024925:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a89766600/0x9eebb2eb7f50d96a lrc: 3/0,1 mode: --/EX res: [0x240000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.024932:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a89766600/0x9eebb2eb7f50d96a lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.024937:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a89766600/0x9eebb2eb7f50d96a lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.025061:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a89767e00/0x9eebb2eb7f50d971 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.025068:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a89767e00/0x9eebb2eb7f50d971 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.025074:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a89767e00/0x9eebb2eb7f50d971 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.025081:0:6478:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a89767e00/0x9eebb2eb7f50d971 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.025086:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a89767e00/0x9eebb2eb7f50d971 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.025090:0:6478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a89767e00/0x9eebb2eb7f50d971 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.025107:0:6478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787096280.025116:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a89766600/0x9eebb2eb7f50d96a lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.025120:0:6478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a89766600/0x9eebb2eb7f50d96a lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.025131:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a89766600/0x9eebb2eb7f50d96a lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.025136:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7a89766600 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:2.0:1787096280.025138:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a89766600/0x9eebb2eb7f50d96a lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.025143:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a89766600/0x9eebb2eb7f50d96a lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.025152:0:6466:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787096280.025154:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3:0x0].0x0 (ffff8c7aadca8400) 00010000:00010000:2.0:1787096280.025157:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787096280.025160:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a89766600/0x9eebb2eb7f50d96a lrc: 2/0,0 mode: --/EX res: [0x240000402:0x3:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.025160:0:6466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a89767e00/0x9eebb2eb7f50d971 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.025207:0:6466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7a89767e00 already unused, calling callback (ffffffffc0bef6f0) 00010000:00010000:2.0:1787096280.025208:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a89766600/0x9eebb2eb7f50d96a lrc: 0/0,0 mode: --/EX res: [0x240000402:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.025217:0:6466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a89767e00/0x9eebb2eb7f50d971 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.025226:0:6466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a89767e00/0x9eebb2eb7f50d971 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.025228:0:6478:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a89766000/0x9eebb2eb7f50d95c lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.025247:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a89766000/0x9eebb2eb7f50d95c lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.025253:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3:0x0].0x0 (ffff8c7aadca8400) 00010000:00010000:2.0:1787096280.025254:0:6478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a89766000/0x9eebb2eb7f50d95c lrc: 3/0,0 mode: CW/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.025262:0:6466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787096280.025270:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a89766000/0x9eebb2eb7f50d95c lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.025270:0:6466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a89767e00/0x9eebb2eb7f50d971 lrc: 1/0,0 mode: --/PW res: [0x240000402:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.025308:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a89767e00/0x9eebb2eb7f50d971 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.025310:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7a89766000 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:2.0:1787096280.025320:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a89766000/0x9eebb2eb7f50d95c lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.025329:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a89766000/0x9eebb2eb7f50d95c lrc: 5/0,0 mode: CW/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.025343:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0x0 (ffff8c7aadca5600) 00010000:00010000:2.0:1787096280.025345:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096280.025349:0:6466:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787096280.025350:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a89766000/0x9eebb2eb7f50d95c lrc: 3/0,0 mode: --/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.025381:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a89766000/0x9eebb2eb7f50d95c lrc: 0/0,0 mode: --/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787096280.025394:0:6478:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000352f5a4c reply state 0000000031f7198f transno 4294967311 ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a89767c00/0x9eebb2eb7f50d963 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0xae2548a7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.025397:0:6466:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787096280.025408:0:6466:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787096280.025409:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a89767c00/0x9eebb2eb7f50d963 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x5:0x0].0xae2548a7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.025417:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0xae2548a7 (ffff8c7aadca8e00) 00010000:00010000:2.0:1787096280.025420:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787096280.025422:0:6478:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787096280.025464:0:6478:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983920000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9858421-28a9-4744-99eb-72e5bedc52c4+25:34754:x1873906077064064:12345-192.168.201.52@tcp:36:rm.0 Request processed in 695us (789us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1787096280.025470:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 180 00000100:00100000:2.0:1787096280.026539:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1787096280.026584:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1787096280.026627:0:6479:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077064448 00000100:00100000:2.0:1787096280.026631:0:6479:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077064448 00000100:00100000:2.0:1787096280.026685:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 30 00000100:00100000:2.0:1787096280.026695:0:6479:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c79838aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9858421-28a9-4744-99eb-72e5bedc52c4+25:34754:x1873906077064448:12345-192.168.201.52@tcp:35:rm.0 00000100:00100000:0.0:1787096280.026711:0:6462:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077064192 00000100:00100000:0.0:1787096280.026719:0:6462:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077064192 00000100:00100000:2.0:1787096280.026842:0:6479:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c79838aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9858421-28a9-4744-99eb-72e5bedc52c4+26:34754:x1873906077064448:12345-192.168.201.52@tcp:35:rm.0 Request processed in 143us (253us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1787096280.026853:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 30 00000100:00100000:0.0:1787096280.026917:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 9 00000100:00100000:0.0:1787096280.026935:0:6462:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c79838abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9858421-28a9-4744-99eb-72e5bedc52c4+8:2407:x1873906077064192:12345-192.168.201.52@tcp:103:rm.0 00010000:00010000:0.0:1787096280.026947:0:6462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787096280.026979:0:6462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a813ec600/0x9eebb2eb7f50d87c lrc: 0/0,0 mode: --/PR res: [0x240000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b4110e expref: 8 pid: 10275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.027001:0:6462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x2:0x0].0x0 (ffff8c7aadca8700) 00010000:00010000:0.0:1787096280.027011:0:6462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787096280.027049:0:6462:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c79838abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9858421-28a9-4744-99eb-72e5bedc52c4+7:2407:x1873906077064192:12345-192.168.201.52@tcp:103:rm.0 Request processed in 122us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096280.027056:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 9 00000100:00100000:2.0:1787096280.027598:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1787096280.027637:0:6477:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077064704 00000100:00100000:0.0:1787096280.027642:0:6477:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077064704 00000100:00100000:0.0:1787096280.027677:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 181 00000100:00100000:0.0:1787096280.027689:0:6477:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c79838a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9858421-28a9-4744-99eb-72e5bedc52c4+26:34754:x1873906077064704:12345-192.168.201.52@tcp:36:rm.0 00010000:00010000:0.0:1787096280.027717:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787096280.027730:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd762200/0x9eebb2eb7f50d932 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41154 expref: 26 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.027744:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7983881e00/0x9eebb2eb7f50d908 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b4113f expref: 25 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.027757:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd762600/0x9eebb2eb7f50d88a lrc: 0/0,0 mode: --/PR res: [0x240000402:0x2:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41115 expref: 24 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.027764:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x2:0x0].0x0 (ffff8c7aadca5400) 00010000:00010000:0.0:1787096280.027767:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787096280.027801:0:6477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd762000/0x9eebb2eb7f50d978 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.027807:0:6477:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd762000/0x9eebb2eb7f50d978 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.027823:0:6477:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd762000/0x9eebb2eb7f50d978 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096280.027845:0:6477:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7983922300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6477:1873906084462208:0@lo:101:mdt00_001.0 00000100:00100000:0.0:1787096280.027887:0:6477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096280.027937:0:6482:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084462208 00000100:00100000:0.0:1787096280.027944:0:6477:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c7982067f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787096280.027945:0:6482:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084462208 00000100:00100000:1.0:1787096280.027989:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787096280.027999:0:6482:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983386680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:6477:x1873906084462208:12345-0@lo:101:mdt00_001.0 00010000:00010000:1.0:1787096280.028016:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096280.028029:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880200/0x9eebb2eb7f50d97f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9eebb2eb7f50d978 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.028047:0:6482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763800/0x9eebb2eb7f50d860 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41107 expref: 6 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.028055:0:6482:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880200/0x9eebb2eb7f50d97f lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x9eebb2eb7f50d978 expref: 8 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.028078:0:6482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763800/0x9eebb2eb7f50d860 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41107 expref: 6 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.028088:0:6482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763800/0x9eebb2eb7f50d860 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41107 expref: 6 pid: 8384 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096280.028098:0:6482:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7983a68000 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:6482:1873906084462336:192.168.201.52@tcp:104: 00000100:00100000:1.0:1787096280.028161:0:6482:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c7983307b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787096280.028994:0:6482:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7983a68000 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:6482:1873906084462336:192.168.201.52@tcp:104: 00010000:00010000:1.0:1787096280.029011:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880200/0x9eebb2eb7f50d97f lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x9eebb2eb7f50d978 expref: 8 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.029019:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c7a92c71300) 00010000:00010000:1.0:1787096280.029021:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096280.029023:0:6482:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880200/0x9eebb2eb7f50d97f lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x9eebb2eb7f50d978 expref: 8 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.029039:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7983880200, rc 0) 00000100:00100000:1.0:1787096280.029082:0:6482:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983386680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:6477:x1873906084462208:12345-0@lo:101:mdt00_001.0 Request processed in 1084us (1194us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096280.029087:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787096280.029106:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1787096280.029138:0:6463:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077064832 00000100:00100000:1.0:1787096280.029143:0:6463:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077064832 00000100:00100000:0.0:1787096280.029165:0:6477:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7983922300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6477:1873906084462208:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1787096280.029173:0:6463:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763800/0x9eebb2eb7f50d860 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41107 expref: 7 pid: 8384 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.029190:0:6477:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd762000/0x9eebb2eb7f50d978 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x9eebb2eb7f50d97f expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.029200:0:6477:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd762000/0x9eebb2eb7f50d978 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x9eebb2eb7f50d97f expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096280.029208:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 63 00000100:00100000:1.0:1787096280.029228:0:6463:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c79838a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9858421-28a9-4744-99eb-72e5bedc52c4+7:2406:x1873906077064832:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787096280.029236:0:6463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787096280.029241:0:6463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763800/0x9eebb2eb7f50d860 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41107 expref: 7 pid: 8384 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.029249:0:6463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763800/0x9eebb2eb7f50d860 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41107 expref: 7 pid: 8384 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.029261:0:6463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763800/0x9eebb2eb7f50d860 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41107 expref: 7 pid: 8384 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.029271:0:6463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c7a92c71300) 00010000:00010000:1.0:1787096280.029274:0:6463:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880200/0x9eebb2eb7f50d97f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x9eebb2eb7f50d978 expref: 7 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.029281:0:6463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880200/0x9eebb2eb7f50d97f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x9eebb2eb7f50d978 expref: 7 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.029294:0:6463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880200/0x9eebb2eb7f50d97f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x9eebb2eb7f50d978 expref: 7 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.029322:0:6463:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880200/0x9eebb2eb7f50d97f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x9eebb2eb7f50d978 expref: 7 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096280.029331:0:6463:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7983a68000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:6463:1873906084462464:0@lo:105: 00000100:00100000:1.0:1787096280.029394:0:6463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096280.029422:0:6463:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c7983307b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787096280.029448:0:6461:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787096280.029461:0:6461:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084462464 00000100:00100000:2.0:1787096280.029464:0:6461:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084462464 00000100:00100000:2.0:1787096280.029508:0:6461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787096280.029516:0:6461:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c79831fd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6463:x1873906084462464:12345-0@lo:105: 00010000:00010000:2.0:1787096280.029526:0:6461:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd762000/0x9eebb2eb7f50d978 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x9eebb2eb7f50d97f expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.029534:0:6461:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd762000/0x9eebb2eb7f50d978 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x9eebb2eb7f50d97f expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.029541:0:6461:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd762000/0x9eebb2eb7f50d978 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x9eebb2eb7f50d97f expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.029546:0:6461:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd762000/0x9eebb2eb7f50d978 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x9eebb2eb7f50d97f expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.029551:0:6461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd762000/0x9eebb2eb7f50d978 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x9eebb2eb7f50d97f expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.029557:0:6461:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd762000/0x9eebb2eb7f50d978 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x9eebb2eb7f50d97f expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.029583:0:6461:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8c7abd762000) 00010000:00010000:0.0:1787096280.029592:0:6477:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd762000/0x9eebb2eb7f50d978 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x9eebb2eb7f50d97f expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.029601:0:6477:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd762000/0x9eebb2eb7f50d978 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x9eebb2eb7f50d97f expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787096280.029620:0:6477:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:2.0:1787096280.029625:0:6461:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c79831fd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6463:x1873906084462464:12345-0@lo:105: Request processed in 107us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096280.029634:0:6461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787096280.029656:0:6463:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7983a68000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:6463:1873906084462464:0@lo:105: 00010000:00010000:0.0:1787096280.029658:0:6477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd762c00/0x9eebb2eb7f50d986 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9280d55e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.029673:0:6477:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd762c00/0x9eebb2eb7f50d986 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9280d55e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.029679:0:6477:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd762c00/0x9eebb2eb7f50d986 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9280d55e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.029686:0:6463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787096280.029704:0:6477:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7983922300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6477:1873906084462592:0@lo:101:mdt00_001.0 00000100:00100000:1.0:1787096280.029733:0:6463:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c79838a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9858421-28a9-4744-99eb-72e5bedc52c4+6:2406:x1873906077064832:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 508us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096280.029750:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 63 00000100:00100000:0.0:1787096280.029753:0:6477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096280.029797:0:6477:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c7982067f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787096280.029808:0:6481:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084462592 00000100:00100000:1.0:1787096280.029813:0:6481:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084462592 00000100:00100000:1.0:1787096280.029844:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787096280.029852:0:6481:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a878b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:6477:x1873906084462592:12345-0@lo:101:mdt00_001.0 00010000:00010000:1.0:1787096280.029860:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096280.029869:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881800/0x9eebb2eb7f50d98d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9280d55e bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9eebb2eb7f50d986 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.029883:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881800/0x9eebb2eb7f50d98d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9280d55e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x9eebb2eb7f50d986 expref: 9 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.029892:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881800/0x9eebb2eb7f50d98d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9280d55e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x9eebb2eb7f50d986 expref: 9 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.029902:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9280d55e (ffff8c7a8b27ab00) 00010000:00010000:1.0:1787096280.029904:0:6481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096280.029906:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7983881800, rc 0) 00000100:00100000:1.0:1787096280.029943:0:6481:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a878b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:6477:x1873906084462592:12345-0@lo:101:mdt00_001.0 Request processed in 93us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096280.029948:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787096280.029976:0:6477:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7983922300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6477:1873906084462592:0@lo:101:mdt00_001.0 00010000:00010000:0.0:1787096280.029988:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd762c00/0x9eebb2eb7f50d986 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9280d55e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x9eebb2eb7f50d98d expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.029999:0:6477:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd762c00/0x9eebb2eb7f50d986 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9280d55e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x9eebb2eb7f50d98d expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787096280.030015:0:6477:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:0.0:1787096280.030059:0:6477:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7983922300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6477:1873906084462720:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787096280.030123:0:6477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096280.030158:0:6477:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c7982067c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787096280.030172:0:7980:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084462720 00000100:00100000:2.0:1787096280.030179:0:7980:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084462720 00000100:00100000:2.0:1787096280.030210:0:7980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787096280.030217:0:7980:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7ab4f31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:6477:x1873906084462720:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787096280.030291:0:7980:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7ab4f31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:6477:x1873906084462720:12345-0@lo:1000:mdt00_001.0 Request processed in 74us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096280.030302:0:7980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787096280.030329:0:6477:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7983922300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6477:1873906084462720:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787096280.030488:0:6477:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7983922300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6477:1873906084462848:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787096280.030524:0:6477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096280.030557:0:7407:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084462848 00000100:00100000:0.0:1787096280.030558:0:6477:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c7982067c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787096280.030564:0:7407:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084462848 00000100:00100000:2.0:1787096280.030600:0:7407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787096280.030608:0:7407:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7aad127480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:6477:x1873906084462848:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787096280.030671:0:7407:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7aad127480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:6477:x1873906084462848:12345-0@lo:1000:mdt00_001.0 Request processed in 65us (147us total) trans 0 rc 1/1 00000100:00100000:2.0:1787096280.030682:0:7407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1787096280.030708:0:6477:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7983922300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6477:1873906084462848:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1787096280.030747:0:6477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd763400/0x9eebb2eb7f50d994 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.030753:0:6477:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd763400/0x9eebb2eb7f50d994 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.030759:0:6477:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd763400/0x9eebb2eb7f50d994 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096280.030777:0:6477:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7983922300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6477:1873906084462976:0@lo:101:mdt00_001.0 00000100:00100000:0.0:1787096280.030807:0:6477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096280.030828:0:6477:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c7982067f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787096280.030841:0:6482:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084462976 00000100:00100000:1.0:1787096280.030846:0:6482:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084462976 00000100:00100000:1.0:1787096280.030874:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1787096280.030881:0:6482:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abd5c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:6477:x1873906084462976:12345-0@lo:101:mdt00_001.0 00010000:00010000:1.0:1787096280.030889:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096280.030899:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881400/0x9eebb2eb7f50d99b lrc: 2/0,0 mode: --/EX res: [0x240000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9eebb2eb7f50d994 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.030912:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881400/0x9eebb2eb7f50d99b lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x9eebb2eb7f50d994 expref: 10 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.030918:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881400/0x9eebb2eb7f50d99b lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x9eebb2eb7f50d994 expref: 10 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.030923:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x2:0x0].0x0 (ffff8c7a8b27ad00) 00010000:00010000:1.0:1787096280.030925:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787096280.030926:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7983881400, rc 0) 00000100:00100000:1.0:1787096280.030957:0:6482:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abd5c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:6477:x1873906084462976:12345-0@lo:101:mdt00_001.0 Request processed in 77us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096280.030962:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1787096280.030995:0:6477:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7983922300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6477:1873906084462976:0@lo:101:mdt00_001.0 00010000:00010000:0.0:1787096280.031011:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd763400/0x9eebb2eb7f50d994 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x9eebb2eb7f50d99b expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.031021:0:6477:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd763400/0x9eebb2eb7f50d994 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x9eebb2eb7f50d99b expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.031042:0:6477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd763c00/0x9eebb2eb7f50d9a2 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.031048:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd763c00/0x9eebb2eb7f50d9a2 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.031055:0:6477:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd763c00/0x9eebb2eb7f50d9a2 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.031067:0:6477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd763000/0x9eebb2eb7f50d9a9 lrc: 3/0,1 mode: --/EX res: [0x240000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.031073:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd763000/0x9eebb2eb7f50d9a9 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.031078:0:6477:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd763000/0x9eebb2eb7f50d9a9 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.031117:0:6477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd763a00/0x9eebb2eb7f50d9b0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.031129:0:6477:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd763a00/0x9eebb2eb7f50d9b0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.031136:0:6477:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd763a00/0x9eebb2eb7f50d9b0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096280.031148:0:6477:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7983922300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6477:1873906084463104:0@lo:101:mdt00_001.0 00000100:00100000:0.0:1787096280.031179:0:6477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096280.031199:0:6477:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c7982067f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787096280.031215:0:6481:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084463104 00000100:00100000:1.0:1787096280.031220:0:6481:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084463104 00000100:00100000:1.0:1787096280.031253:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1787096280.031259:0:6481:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7aac3cd050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:6477:x1873906084463104:12345-0@lo:101:mdt00_001.0 00010000:00010000:1.0:1787096280.031266:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096280.031275:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880a00/0x9eebb2eb7f50d9b7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9eebb2eb7f50d9b0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.031289:0:6481:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7aa2750a00/0x9eebb2eb7f50d8a6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41123 expref: 5 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.031294:0:6481:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880a00/0x9eebb2eb7f50d9b7 lrc: 4/0,0 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x9eebb2eb7f50d9b0 expref: 11 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.031309:0:6481:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c7aa2750a00/0x9eebb2eb7f50d8a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41123 expref: 5 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.031316:0:6481:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7aa2750a00/0x9eebb2eb7f50d8a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41123 expref: 5 pid: 6476 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096280.031324:0:6481:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7983a68000 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:6481:1873906084463232:192.168.201.52@tcp:104: 00000100:00100000:1.0:1787096280.031429:0:6481:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c7983307b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787096280.032195:0:6481:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7983a68000 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:6481:1873906084463232:192.168.201.52@tcp:104: 00010000:00010000:1.0:1787096280.032210:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880a00/0x9eebb2eb7f50d9b7 lrc: 3/0,0 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x9eebb2eb7f50d9b0 expref: 11 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.032217:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff8c7a92c71400) 00010000:00010000:1.0:1787096280.032226:0:6481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787096280.032229:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880a00/0x9eebb2eb7f50d9b7 lrc: 3/0,0 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x9eebb2eb7f50d9b0 expref: 11 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.032236:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880a00/0x9eebb2eb7f50d9b7 lrc: 3/0,0 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x9eebb2eb7f50d9b0 expref: 11 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.032241:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7983880a00, rc 0) 00000100:00100000:1.0:1787096280.032284:0:6481:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7aac3cd050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:6477:x1873906084463104:12345-0@lo:101:mdt00_001.0 Request processed in 1024us (1103us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096280.032291:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787096280.032310:0:6477:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7983922300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6477:1873906084463104:0@lo:101:mdt00_001.0 00010000:00010000:2.0:1787096280.032327:0:6477:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd763a00/0x9eebb2eb7f50d9b0 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x9eebb2eb7f50d9b7 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.032335:0:6477:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd763a00/0x9eebb2eb7f50d9b0 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x9eebb2eb7f50d9b7 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096280.032459:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1787096280.032495:0:10225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077064960 00000100:00100000:2.0:1787096280.032500:0:10225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077064960 00010000:00010000:2.0:1787096280.032520:0:10225:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7aa2750a00/0x9eebb2eb7f50d8a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41123 expref: 6 pid: 6476 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096280.032548:0:10225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 64 00000100:00100000:2.0:1787096280.032558:0:10225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7982f52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f9858421-28a9-4744-99eb-72e5bedc52c4+6:2407:x1873906077064960:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787096280.032566:0:10225:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787096280.032572:0:10225:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c7aa2750a00/0x9eebb2eb7f50d8a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41123 expref: 6 pid: 6476 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.032583:0:10225:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c7aa2750a00/0x9eebb2eb7f50d8a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41123 expref: 6 pid: 6476 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.032606:0:10225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7aa2750a00/0x9eebb2eb7f50d8a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41123 expref: 6 pid: 6476 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.032628:0:10225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff8c7a92c71400) 00010000:00010000:2.0:1787096280.032632:0:10225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880a00/0x9eebb2eb7f50d9b7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x9eebb2eb7f50d9b0 expref: 10 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.032640:0:10225:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880a00/0x9eebb2eb7f50d9b7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x9eebb2eb7f50d9b0 expref: 10 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.032647:0:10225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880a00/0x9eebb2eb7f50d9b7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x9eebb2eb7f50d9b0 expref: 10 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.032680:0:10225:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880a00/0x9eebb2eb7f50d9b7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x9eebb2eb7f50d9b0 expref: 10 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096280.032687:0:10225:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c79838a9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000_UUID:10225:1873906084463360:0@lo:105: 00000100:00100000:2.0:1787096280.032709:0:10225:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096280.032735:0:10225:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c7a89103000 going to sleep for 11 seconds 00000100:00100000:1.0:1787096280.032754:0:8373:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084463360 00000100:00100000:1.0:1787096280.032759:0:8373:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084463360 00000100:00100000:1.0:1787096280.032793:0:8373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787096280.032801:0:8373:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983386a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:10225:x1873906084463360:12345-0@lo:105: 00010000:00010000:1.0:1787096280.032808:0:8373:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd763a00/0x9eebb2eb7f50d9b0 lrc: 5/0,1 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x9eebb2eb7f50d9b7 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.032815:0:8373:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd763a00/0x9eebb2eb7f50d9b0 lrc: 5/0,1 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x9eebb2eb7f50d9b7 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.032820:0:8373:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd763a00/0x9eebb2eb7f50d9b0 lrc: 5/0,1 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x9eebb2eb7f50d9b7 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.032827:0:8373:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd763a00/0x9eebb2eb7f50d9b0 lrc: 5/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x9eebb2eb7f50d9b7 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.032835:0:8373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd763a00/0x9eebb2eb7f50d9b0 lrc: 6/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x9eebb2eb7f50d9b7 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.032854:0:8373:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd763a00/0x9eebb2eb7f50d9b0 lrc: 6/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x9eebb2eb7f50d9b7 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.032875:0:8373:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8c7abd763a00) 00010000:00010000:2.0:1787096280.032886:0:6477:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd763a00/0x9eebb2eb7f50d9b0 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x9eebb2eb7f50d9b7 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.032893:0:6477:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd763a00/0x9eebb2eb7f50d9b0 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x9eebb2eb7f50d9b7 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096280.032929:0:8373:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983386a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:10225:x1873906084463360:12345-0@lo:105: Request processed in 128us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096280.032938:0:8373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787096280.032964:0:10225:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c79838a9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000_UUID:10225:1873906084463360:0@lo:105: 00010000:00010000:3.0:1787096280.032986:0:10225:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787096280.033036:0:10225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7982f52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f9858421-28a9-4744-99eb-72e5bedc52c4+5:2407:x1873906077064960:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 479us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096280.033046:0:10225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 64 00000100:00100000:2.0:1787096280.033595:0:6477:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7983384000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6477:1873906084463488:0@lo:403:mdt00_001.0 00000100:00100000:2.0:1787096280.033658:0:6477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096280.033674:0:6477:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c7a89103cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787096280.033697:0:7980:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084463488 00000100:00100000:3.0:1787096280.033703:0:7980:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084463488 00000100:00100000:3.0:1787096280.033738:0:7980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1787096280.033747:0:7980:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983385880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+11:6477:x1873906084463488:12345-0@lo:403:mdt00_001.0 00000100:00100000:3.0:1787096280.036213:0:7980:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983385880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+11:6477:x1873906084463488:12345-0@lo:403:mdt00_001.0 Request processed in 2466us (2552us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096280.036226:0:7980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787096280.036237:0:6477:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7983384000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6477:1873906084463488:0@lo:403:mdt00_001.0 00000040:00080000:0.0:1787096280.037557:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].4, 936 off38944 00000040:00080000:0.0:1787096280.037740:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].4, 1016 off39504 00000004:00080000:0.0:1787096280.037746:0:6477:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8c7982067c00 with version 7 00000004:00080000:1.0:1787096280.037791:0:7405:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff8c7aad23da80 version 7 rpc_version 7 00000020:00100000:1.0:1787096280.037828:0:7405:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787096280.037837:0:7405:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c7983a6bb80 x1873906084463744/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2592/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787096280.037855:0:7405:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7983a6bb80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7405:1873906084463744:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787096280.037895:0:7405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096280.037919:0:7405:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c7983307b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787096280.037939:0:7407:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084463744 00000100:00100000:3.0:1787096280.037946:0:7407:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084463744 00000100:00100000:3.0:1787096280.037979:0:7407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1787096280.037989:0:7407:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983a68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:7405:x1873906084463744:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787096280.038426:0:7407:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983a68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:7405:x1873906084463744:12345-0@lo:1000:osp_up0-1.0 Request processed in 433us (525us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1787096280.038445:0:7407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1787096280.038501:0:7405:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7983a6bb80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7405:1873906084463744:0@lo:1000:osp_up0-1.0 00000004:00200000:0.0:1787096280.038540:0:6477:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000402:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1787096280.038556:0:6477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd763000/0x9eebb2eb7f50d9a9 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.038564:0:6477:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd763000/0x9eebb2eb7f50d9a9 lrc: 2/0,0 mode: EX/EX res: [0x240000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.038570:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd763000/0x9eebb2eb7f50d9a9 lrc: 3/0,0 mode: EX/EX res: [0x240000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.038575:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7abd763000 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:0.0:1787096280.038579:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd763000/0x9eebb2eb7f50d9a9 lrc: 3/0,0 mode: EX/EX res: [0x240000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.038584:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd763000/0x9eebb2eb7f50d9a9 lrc: 4/0,0 mode: EX/EX res: [0x240000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.038604:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0x0 (ffff8c7aadca5600) 00010000:00010000:0.0:1787096280.038607:0:6477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787096280.038610:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd763000/0x9eebb2eb7f50d9a9 lrc: 2/0,0 mode: --/EX res: [0x240000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.038615:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd763000/0x9eebb2eb7f50d9a9 lrc: 0/0,0 mode: --/EX res: [0x240000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.038626:0:6477:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd763a00/0x9eebb2eb7f50d9b0 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x9eebb2eb7f50d9b7 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.038631:0:6477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd763a00/0x9eebb2eb7f50d9b0 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x9eebb2eb7f50d9b7 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.038637:0:6477:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd763a00/0x9eebb2eb7f50d9b0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x9eebb2eb7f50d9b7 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.038657:0:6477:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1787096280.038663:0:6477:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000401:0x5:0x0] 00010000:00010000:0.0:1787096280.038667:0:6477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd763c00/0x9eebb2eb7f50d9a2 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.038671:0:6477:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd763c00/0x9eebb2eb7f50d9a2 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.038676:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd763c00/0x9eebb2eb7f50d9a2 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.038681:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7abd763c00 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:0.0:1787096280.038683:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd763c00/0x9eebb2eb7f50d9a2 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096280.038688:0:7400:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787096280.038703:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd763c00/0x9eebb2eb7f50d9a2 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096280.038704:0:7400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd763a00/0x9eebb2eb7f50d9b0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x9eebb2eb7f50d9b7 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.038724:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x2:0x0].0x0 (ffff8c7aadca5400) 00010000:00010000:0.0:1787096280.038729:0:6477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096280.038731:0:7400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7abd763a00 already unused, calling callback (ffffffffc1765ee0) 00010000:00010000:0.0:1787096280.038732:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd763c00/0x9eebb2eb7f50d9a2 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.038742:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd763c00/0x9eebb2eb7f50d9a2 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096280.038743:0:7400:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd763a00/0x9eebb2eb7f50d9b0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x9eebb2eb7f50d9b7 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.038771:0:6477:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd763400/0x9eebb2eb7f50d994 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x9eebb2eb7f50d99b expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787096280.038775:0:7400:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd763a00/0x9eebb2eb7f50d9b0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x9eebb2eb7f50d9b7 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.038784:0:6477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd763400/0x9eebb2eb7f50d994 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x9eebb2eb7f50d99b expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.038812:0:6477:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd763400/0x9eebb2eb7f50d994 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x9eebb2eb7f50d99b expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.038829:0:6477:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1787096280.038839:0:6477:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1787096280.038844:0:6477:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd762000/0x9eebb2eb7f50d978 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x9eebb2eb7f50d97f expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.038851:0:8374:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787096280.038853:0:6477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd762000/0x9eebb2eb7f50d978 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x9eebb2eb7f50d97f expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096280.038854:0:7400:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd763a00/0x9eebb2eb7f50d9b0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x9eebb2eb7f50d9b7 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.038859:0:8374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd763400/0x9eebb2eb7f50d994 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x9eebb2eb7f50d99b expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.038905:0:6477:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd762000/0x9eebb2eb7f50d978 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x9eebb2eb7f50d97f expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096280.038908:0:7400:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787096280.038908:0:8374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7abd763400 already unused, calling callback (ffffffffc1765ee0) 00010000:00010000:1.0:1787096280.038919:0:8374:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd763400/0x9eebb2eb7f50d994 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x9eebb2eb7f50d99b expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787096280.038935:0:8374:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd763400/0x9eebb2eb7f50d994 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x9eebb2eb7f50d99b expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.038943:0:6477:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1787096280.038955:0:6477:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1787096280.038956:0:7400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd763a00/0x9eebb2eb7f50d9b0 lrc: 1/0,0 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x9eebb2eb7f50d9b7 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096280.038970:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1787096280.038971:0:7400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd763a00/0x9eebb2eb7f50d9b0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x9eebb2eb7f50d9b7 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.038973:0:8374:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd763400/0x9eebb2eb7f50d994 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x9eebb2eb7f50d99b expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096280.038985:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7982f51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1873906084463872:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787096280.039008:0:8374:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787096280.039027:0:7400:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787096280.039031:0:8374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd763400/0x9eebb2eb7f50d994 lrc: 1/0,0 mode: --/EX res: [0x240000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x9eebb2eb7f50d99b expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096280.039034:0:7400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd762000/0x9eebb2eb7f50d978 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x9eebb2eb7f50d97f expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.039042:0:8374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd763400/0x9eebb2eb7f50d994 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x9eebb2eb7f50d99b expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096280.039056:0:7400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7abd762000 already unused, calling callback (ffffffffc1765ee0) 00000100:00100000:0.0:1787096280.039058:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787096280.039069:0:7400:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd762000/0x9eebb2eb7f50d978 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x9eebb2eb7f50d97f expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787096280.039082:0:7400:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd762000/0x9eebb2eb7f50d978 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x9eebb2eb7f50d97f expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.039102:0:8374:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787096280.039108:0:8374:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787096280.039117:0:8374:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787096280.039122:0:7400:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd762000/0x9eebb2eb7f50d978 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x9eebb2eb7f50d97f expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096280.039131:0:7400:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787096280.039132:0:6465:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787096280.039144:0:7401:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084463872 00010000:00010000:3.0:1787096280.039148:0:7400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd762000/0x9eebb2eb7f50d978 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x9eebb2eb7f50d97f expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096280.039148:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7983a6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1873906084464000:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787096280.039149:0:7401:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084463872 00010000:00010000:3.0:1787096280.039179:0:7400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd762000/0x9eebb2eb7f50d978 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x9eebb2eb7f50d97f expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096280.039208:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096280.039208:0:7401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1787096280.039209:0:7400:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787096280.039222:0:7400:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787096280.039232:0:7400:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787096280.039234:0:7401:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983922300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+12:3628:x1873906084463872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787096280.039246:0:7401:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1787096280.039249:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787096280.039260:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7982f50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1873906084464128:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787096280.039266:0:7401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880a00/0x9eebb2eb7f50d9b7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x9eebb2eb7f50d9b0 expref: 12 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.039288:0:7401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff8c7a92c71400) 00000100:00100000:1.0:1787096280.039298:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787096280.039303:0:7401:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787096280.039332:0:6463:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084464000 00000100:00100000:3.0:1787096280.039340:0:6463:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084464000 00000100:00100000:1.0:1787096280.039389:0:8375:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084464128 00000100:00100000:1.0:1787096280.039393:0:8375:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084464128 00000100:00100000:3.0:1787096280.039430:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787096280.039457:0:6463:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a90584850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+13:3626:x1873906084464000:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787096280.039460:0:8375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1787096280.039489:0:6463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1787096280.039490:0:8375:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983a69880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+13:3626:x1873906084464128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787096280.039501:0:8375:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787096280.039508:0:6463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881400/0x9eebb2eb7f50d99b lrc: 0/0,0 mode: --/EX res: [0x240000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x9eebb2eb7f50d994 expref: 13 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.039515:0:8375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880200/0x9eebb2eb7f50d97f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x9eebb2eb7f50d978 expref: 13 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096280.039541:0:6463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x2:0x0].0x0 (ffff8c7a8b27ad00) 00010000:00010000:1.0:1787096280.039552:0:8375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c7a92c71300) 00010000:00010000:1.0:1787096280.039558:0:8375:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787096280.039567:0:6463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787096280.039634:0:8375:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983a69880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+11:3626:x1873906084464128:12345-0@lo:103:ldlm_bl.0 Request processed in 160us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096280.039646:0:8375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787096280.039656:0:6463:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a90584850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+11:3626:x1873906084464000:12345-0@lo:103:ldlm_bl.0 Request processed in 210us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096280.039673:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787096280.039704:0:7401:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983922300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+9:3628:x1873906084463872:12345-0@lo:103:ldlm_bl.0 Request processed in 474us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096280.039712:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7982f50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1873906084464128:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787096280.039716:0:7401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787096280.039752:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7983a6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1873906084464000:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787096280.039823:0:6477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd762c00/0x9eebb2eb7f50d986 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9280d55e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x9eebb2eb7f50d98d expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.039829:0:6477:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7abd762c00/0x9eebb2eb7f50d986 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9280d55e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x9eebb2eb7f50d98d expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096280.039837:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7982f51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1873906084463872:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787096280.039881:0:6477:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c79838a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9858421-28a9-4744-99eb-72e5bedc52c4+24:34754:x1873906077064704:12345-192.168.201.52@tcp:36:rm.0 Request processed in 12194us (12281us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1787096280.039886:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 181 00000001:02000400:2.0:1787096280.587265:0:22206:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 23c: fallocate on EC file ============== 19:37:59 (1787096279) 00010000:00010000:0.0:1787096280.752505:0:6466:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787096280.951196:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1787096280.951247:0:6476:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077065088 00000100:00100000:2.0:1787096280.951259:0:6476:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077065088 00000100:00100000:2.0:1787096280.951318:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 182 00000100:00100000:2.0:1787096280.951328:0:6476:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7982f53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9858421-28a9-4744-99eb-72e5bedc52c4+5:34937:x1873906077065088:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:2.0:1787096280.951372:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096280.951395:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a813ed800/0x9eebb2eb7f50d9be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ef7bc65b7b41162 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.951485:0:6476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a813eca00/0x9eebb2eb7f50d9c5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.951511:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a813eca00/0x9eebb2eb7f50d9c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.951523:0:6476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a813eca00/0x9eebb2eb7f50d9c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787096280.951572:0:6476:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787096280.951575:0:6476:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787096280.951596:0:6476:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a813eca00/0x9eebb2eb7f50d9c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.951620:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a813ed800/0x9eebb2eb7f50d9be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41162 expref: 7 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.951636:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a813eca00/0x9eebb2eb7f50d9c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41162 expref: 6 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.951643:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c7a92c71300) 00010000:00010000:2.0:1787096280.951646:0:6476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787096280.951649:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7a813eca00, rc 0) 00000100:00100000:2.0:1787096280.951709:0:6476:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7982f53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9858421-28a9-4744-99eb-72e5bedc52c4+6:34937:x1873906077065088:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 383us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096280.951715:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 182 00000100:00100000:3.0:1787096280.952661:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1787096280.952698:0:21727:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077065216 00000100:00100000:1.0:1787096280.952704:0:21727:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077065216 00000100:00100000:1.0:1787096280.952744:0:21727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 183 00000100:00100000:1.0:1787096280.952752:0:21727:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7982f52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f9858421-28a9-4744-99eb-72e5bedc52c4+6:34937:x1873906077065216:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:1.0:1787096280.952760:0:21727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096280.952769:0:21727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881c00/0x9eebb2eb7f50d9cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ef7bc65b7b41169 expref: -99 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.952802:0:21727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881e00/0x9eebb2eb7f50d9d3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.952817:0:21727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881e00/0x9eebb2eb7f50d9d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.952824:0:21727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881e00/0x9eebb2eb7f50d9d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.954120:0:21727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881200/0x9eebb2eb7f50d9da lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb790e34b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.954142:0:21727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881200/0x9eebb2eb7f50d9da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.954153:0:21727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881200/0x9eebb2eb7f50d9da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.954196:0:21727:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881e00/0x9eebb2eb7f50d9d3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.954203:0:21727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881e00/0x9eebb2eb7f50d9d3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.954208:0:21727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881e00/0x9eebb2eb7f50d9d3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.954213:0:21727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881e00/0x9eebb2eb7f50d9d3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.954218:0:21727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7983881e00 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:1.0:1787096280.954222:0:21727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881e00/0x9eebb2eb7f50d9d3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.954228:0:21727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881e00/0x9eebb2eb7f50d9d3 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.954255:0:21727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c7a92c71300) 00010000:00010000:1.0:1787096280.954257:0:21727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096280.954262:0:21727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881e00/0x9eebb2eb7f50d9d3 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.954268:0:21727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881e00/0x9eebb2eb7f50d9d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.954289:0:21727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881200/0x9eebb2eb7f50d9da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.954294:0:21727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881200/0x9eebb2eb7f50d9da lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.954298:0:21727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881200/0x9eebb2eb7f50d9da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.954303:0:21727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7983881200 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:1.0:1787096280.954305:0:21727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881200/0x9eebb2eb7f50d9da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.954308:0:21727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881200/0x9eebb2eb7f50d9da lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.954313:0:21727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb790e34b (ffff8c7a8b27a300) 00010000:00010000:1.0:1787096280.954315:0:21727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096280.954317:0:21727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881200/0x9eebb2eb7f50d9da lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.954321:0:21727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881200/0x9eebb2eb7f50d9da lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.954471:0:21727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881c00/0x9eebb2eb7f50d9cc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41169 expref: 7 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.954501:0:21727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c7a92c71300) 00010000:00010000:1.0:1787096280.954504:0:21727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096280.954511:0:21727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881c00/0x9eebb2eb7f50d9cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41169 expref: 7 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.954531:0:21727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7983881c00, rc 0) 00000100:00100000:1.0:1787096280.954633:0:21727:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7982f52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f9858421-28a9-4744-99eb-72e5bedc52c4+6:34937:x1873906077065216:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 1879us (1970us total) trans 0 rc 301/301 00000100:00100000:1.0:1787096280.954644:0:21727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 183 00000100:00100000:2.0:1787096280.957435:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1787096280.957502:0:8384:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077065472 00000100:00100000:2.0:1787096280.957509:0:8384:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077065472 00000100:00100000:2.0:1787096280.957574:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 184 00000100:00100000:2.0:1787096280.957585:0:8384:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983387100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9858421-28a9-4744-99eb-72e5bedc52c4+24:34937:x1873906077065472:12345-192.168.201.52@tcp:36:lfs.0 00000100:00100000:2.0:1787096280.957716:0:8384:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7983384e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8384:1873906084464256:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787096280.957777:0:8384:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096280.957839:0:8384:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c7a89103000 going to sleep for 11 seconds 00000100:00100000:2.0:1787096280.957896:0:6482:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084464256 00000100:00100000:2.0:1787096280.957900:0:6482:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084464256 00000100:00100000:2.0:1787096280.957957:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787096280.957968:0:6482:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983386680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:8384:x1873906084464256:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787096280.958053:0:6482:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983386680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:8384:x1873906084464256:12345-0@lo:1000:mdt00_003.0 Request processed in 89us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096280.958063:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787096280.958124:0:8384:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7983384e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8384:1873906084464256:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787096280.958200:0:8384:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7983384e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8384:1873906084464384:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787096280.958240:0:8384:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096280.958268:0:8384:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c7abf92c300 going to sleep for 11 seconds 00000100:00100000:1.0:1787096280.958281:0:6481:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084464384 00000100:00100000:1.0:1787096280.958290:0:6481:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084464384 00000100:00100000:1.0:1787096280.958339:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1787096280.958350:0:6481:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983384380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:8384:x1873906084464384:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787096280.958527:0:6481:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983384380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:8384:x1873906084464384:12345-0@lo:1000:mdt00_003.0 Request processed in 178us (284us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787096280.958540:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787096280.958545:0:8384:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7983384e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8384:1873906084464384:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1787096280.958602:0:8384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a813ed800/0x9eebb2eb7f50d9e1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.958609:0:8384:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a813ed800/0x9eebb2eb7f50d9e1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.958619:0:8384:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a813ed800/0x9eebb2eb7f50d9e1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096280.958633:0:8384:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7983384e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8384:1873906084464512:0@lo:101:mdt00_003.0 00000100:00100000:2.0:1787096280.958667:0:8384:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096280.958713:0:8384:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c7abf92cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787096280.958734:0:6482:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084464512 00000100:00100000:1.0:1787096280.958742:0:6482:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084464512 00000100:00100000:1.0:1787096280.958812:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1787096280.958831:0:6482:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983384000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:8384:x1873906084464512:12345-0@lo:101:mdt00_003.0 00010000:00010000:1.0:1787096280.958846:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096280.958866:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880e00/0x9eebb2eb7f50d9e8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9eebb2eb7f50d9e1 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.958931:0:6482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a813eca00/0x9eebb2eb7f50d9c5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41162 expref: 5 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.958943:0:6482:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880e00/0x9eebb2eb7f50d9e8 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x9eebb2eb7f50d9e1 expref: 10 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.958983:0:6482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a813eca00/0x9eebb2eb7f50d9c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41162 expref: 5 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.959007:0:6482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a813eca00/0x9eebb2eb7f50d9c5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41162 expref: 5 pid: 6476 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096280.959026:0:6482:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7983a6b480 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:6482:1873906084464640:192.168.201.52@tcp:104: 00000100:00100000:1.0:1787096280.959128:0:6482:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c7a863f8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787096280.959900:0:6482:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7983a6b480 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:6482:1873906084464640:192.168.201.52@tcp:104: 00010000:00010000:1.0:1787096280.959939:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880e00/0x9eebb2eb7f50d9e8 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x9eebb2eb7f50d9e1 expref: 10 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.959946:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c7a92c71300) 00010000:00010000:1.0:1787096280.959949:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096280.959952:0:6482:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880e00/0x9eebb2eb7f50d9e8 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x9eebb2eb7f50d9e1 expref: 10 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.959959:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7983880e00, rc 0) 00000100:00100000:1.0:1787096280.960000:0:6482:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983384000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:8384:x1873906084464512:12345-0@lo:101:mdt00_003.0 Request processed in 1173us (1330us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096280.960012:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1787096280.960061:0:8384:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7983384e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8384:1873906084464512:0@lo:101:mdt00_003.0 00010000:00010000:1.0:1787096280.960080:0:8384:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a813ed800/0x9eebb2eb7f50d9e1 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x9eebb2eb7f50d9e8 expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.960088:0:8384:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a813ed800/0x9eebb2eb7f50d9e1 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x9eebb2eb7f50d9e8 expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096280.960130:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1787096280.960163:0:8375:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077065600 00000100:00100000:2.0:1787096280.960170:0:8375:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077065600 00010000:00010000:2.0:1787096280.960196:0:8375:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a813eca00/0x9eebb2eb7f50d9c5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41162 expref: 6 pid: 6476 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096280.960233:0:8375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 65 00000100:00100000:2.0:1787096280.960243:0:8375:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983922300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f9858421-28a9-4744-99eb-72e5bedc52c4+6:2406:x1873906077065600:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787096280.960252:0:8375:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787096280.960257:0:8375:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a813eca00/0x9eebb2eb7f50d9c5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41162 expref: 6 pid: 6476 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.960267:0:8375:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a813eca00/0x9eebb2eb7f50d9c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41162 expref: 6 pid: 6476 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.960284:0:8375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a813eca00/0x9eebb2eb7f50d9c5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41162 expref: 6 pid: 6476 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.960293:0:8375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c7a92c71300) 00010000:00010000:2.0:1787096280.960297:0:8375:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880e00/0x9eebb2eb7f50d9e8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x9eebb2eb7f50d9e1 expref: 9 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.960306:0:8375:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880e00/0x9eebb2eb7f50d9e8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x9eebb2eb7f50d9e1 expref: 9 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.960312:0:8375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880e00/0x9eebb2eb7f50d9e8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x9eebb2eb7f50d9e1 expref: 9 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.960333:0:8375:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880e00/0x9eebb2eb7f50d9e8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x9eebb2eb7f50d9e1 expref: 9 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096280.960350:0:8375:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7a879f1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:8375:1873906084464768:0@lo:105: 00000100:00100000:2.0:1787096280.960410:0:8375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096280.960432:0:6460:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084464768 00000100:00100000:0.0:1787096280.960436:0:6460:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084464768 00000100:00100000:2.0:1787096280.960438:0:8375:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c7abf92c300 going to sleep for 11 seconds 00000100:00100000:0.0:1787096280.960485:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787096280.960498:0:6460:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a879f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:8375:x1873906084464768:12345-0@lo:105: 00010000:00010000:0.0:1787096280.960509:0:6460:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a813ed800/0x9eebb2eb7f50d9e1 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x9eebb2eb7f50d9e8 expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.960523:0:6460:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a813ed800/0x9eebb2eb7f50d9e1 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x9eebb2eb7f50d9e8 expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.960530:0:6460:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a813ed800/0x9eebb2eb7f50d9e1 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x9eebb2eb7f50d9e8 expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.960536:0:6460:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a813ed800/0x9eebb2eb7f50d9e1 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x9eebb2eb7f50d9e8 expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.960541:0:6460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a813ed800/0x9eebb2eb7f50d9e1 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x9eebb2eb7f50d9e8 expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.960546:0:6460:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a813ed800/0x9eebb2eb7f50d9e1 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x9eebb2eb7f50d9e8 expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.960564:0:6460:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8c7a813ed800) 00010000:00010000:1.0:1787096280.960584:0:8384:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a813ed800/0x9eebb2eb7f50d9e1 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x9eebb2eb7f50d9e8 expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.960594:0:8384:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a813ed800/0x9eebb2eb7f50d9e1 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x9eebb2eb7f50d9e8 expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096280.960605:0:6460:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a879f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:8375:x1873906084464768:12345-0@lo:105: Request processed in 113us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096280.960611:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000004:00080000:1.0:1787096280.960620:0:8384:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:0.0:1787096280.960652:0:8375:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7a879f1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:8375:1873906084464768:0@lo:105: 00010000:00010000:1.0:1787096280.960657:0:8384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7983880c00/0x9eebb2eb7f50d9ef lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.960664:0:8384:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7983880c00/0x9eebb2eb7f50d9ef lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.960667:0:8375:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787096280.960675:0:8384:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7983880c00/0x9eebb2eb7f50d9ef lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096280.960690:0:8384:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7983a6b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8384:1873906084464896:0@lo:101:mdt00_003.0 00000100:00100000:0.0:1787096280.960699:0:8375:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983922300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f9858421-28a9-4744-99eb-72e5bedc52c4+5:2406:x1873906077065600:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 459us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096280.960705:0:8375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 65 00000100:00100000:1.0:1787096280.960727:0:8384:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096280.960756:0:8384:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c7a863f8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787096280.960787:0:7407:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084464896 00000100:00100000:1.0:1787096280.960798:0:7407:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084464896 00000100:00100000:1.0:1787096280.960828:0:7407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787096280.960836:0:7407:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983a69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:8384:x1873906084464896:12345-0@lo:101:mdt00_003.0 00010000:00010000:1.0:1787096280.960844:0:7407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096280.960858:0:7407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881600/0x9eebb2eb7f50d9f6 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9eebb2eb7f50d9ef expref: -99 pid: 7407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.960873:0:7407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881600/0x9eebb2eb7f50d9f6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x9eebb2eb7f50d9ef expref: 11 pid: 7407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.960884:0:7407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881600/0x9eebb2eb7f50d9f6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x9eebb2eb7f50d9ef expref: 11 pid: 7407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.960890:0:7407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb790e34b (ffff8c7a8b27a900) 00010000:00010000:1.0:1787096280.960893:0:7407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096280.960895:0:7407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7983881600, rc 0) 00000100:00100000:1.0:1787096280.960926:0:7407:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983a69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:8384:x1873906084464896:12345-0@lo:101:mdt00_003.0 Request processed in 91us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096280.960930:0:7407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787096280.960963:0:8384:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7983a6b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8384:1873906084464896:0@lo:101:mdt00_003.0 00010000:00010000:1.0:1787096280.960972:0:8384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7983880c00/0x9eebb2eb7f50d9ef lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x9eebb2eb7f50d9f6 expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.960980:0:8384:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7983880c00/0x9eebb2eb7f50d9ef lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x9eebb2eb7f50d9f6 expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787096280.960999:0:8384:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:1.0:1787096280.961026:0:8384:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7983a6b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8384:1873906084465024:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787096280.961051:0:8384:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096280.961071:0:8384:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c7ab3f50600 going to sleep for 11 seconds 00000100:00100000:0.0:1787096280.961086:0:7980:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084465024 00000100:00100000:0.0:1787096280.961093:0:7980:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084465024 00000100:00100000:0.0:1787096280.961133:0:7980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1787096280.961139:0:7980:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983a6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+11:8384:x1873906084465024:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787096280.961204:0:7980:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983a6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+11:8384:x1873906084465024:12345-0@lo:1000:mdt00_003.0 Request processed in 66us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096280.961211:0:7980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1787096280.961267:0:8384:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7983a6b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8384:1873906084465024:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787096280.961309:0:8384:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7983923480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8384:1873906084465152:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787096280.961333:0:8384:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096280.961349:0:8384:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c79831ab3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787096280.961418:0:7407:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084465152 00000100:00100000:0.0:1787096280.961420:0:7407:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084465152 00000100:00100000:0.0:1787096280.961440:0:7407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787096280.961447:0:7407:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983923800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:8384:x1873906084465152:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787096280.961531:0:7407:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983923800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:8384:x1873906084465152:12345-0@lo:1000:mdt00_003.0 Request processed in 86us (199us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787096280.961536:0:7407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787096280.961560:0:8384:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7983923480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8384:1873906084465152:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787096280.961629:0:8384:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7983923480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8384:1873906084465280:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787096280.961645:0:8384:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096280.961661:0:8384:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c79831ab3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787096280.961675:0:7980:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084465280 00000100:00100000:1.0:1787096280.961681:0:7980:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084465280 00000100:00100000:1.0:1787096280.961717:0:7980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1787096280.961725:0:7980:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983920a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+11:8384:x1873906084465280:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787096280.961793:0:7980:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983920a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+11:8384:x1873906084465280:12345-0@lo:1000:mdt00_003.0 Request processed in 67us (144us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787096280.961804:0:7980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787096280.961816:0:8384:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7983923480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8384:1873906084465280:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787096280.961865:0:8384:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7983923480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8384:1873906084465408:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787096280.961889:0:8384:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096280.961906:0:8384:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c79831ab3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787096280.961918:0:6481:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084465408 00000100:00100000:1.0:1787096280.961922:0:6481:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084465408 00000100:00100000:1.0:1787096280.961947:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787096280.961953:0:6481:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983920380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:8384:x1873906084465408:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787096280.962005:0:6481:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983920380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:8384:x1873906084465408:12345-0@lo:1000:mdt00_003.0 Request processed in 50us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096280.962011:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787096280.962023:0:8384:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7983923480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8384:1873906084465408:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787096280.962067:0:8384:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7983923480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8384:1873906084465536:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787096280.962094:0:8384:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096280.962115:0:8384:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c79831ab3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787096280.962121:0:6482:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084465536 00000100:00100000:1.0:1787096280.962125:0:6482:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084465536 00000100:00100000:1.0:1787096280.962155:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787096280.962164:0:6482:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a88e15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:8384:x1873906084465536:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787096280.962218:0:6482:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a88e15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:8384:x1873906084465536:12345-0@lo:1000:mdt00_003.0 Request processed in 54us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096280.962224:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787096280.962234:0:8384:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7983923480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8384:1873906084465536:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787096280.962270:0:8384:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7983923480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8384:1873906084465664:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787096280.962292:0:8384:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096280.962309:0:8384:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c79831ab3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787096280.962320:0:7407:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084465664 00000100:00100000:1.0:1787096280.962324:0:7407:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084465664 00000100:00100000:1.0:1787096280.962349:0:7407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1787096280.962405:0:7407:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7ab3eb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:8384:x1873906084465664:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787096280.962491:0:7407:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7ab3eb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:8384:x1873906084465664:12345-0@lo:1000:mdt00_003.0 Request processed in 135us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096280.962502:0:7407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787096280.962532:0:8384:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7983923480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8384:1873906084465664:0@lo:1000:mdt00_003.0 00000040:00080000:2.0:1787096280.963302:0:8384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].5, 2152 off41096 00000040:00080000:2.0:1787096280.963916:0:8384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].5, 2352 off41856 00000004:00080000:2.0:1787096280.963922:0:8384:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8c7abf92c780 with version 8 00000004:00080000:1.0:1787096280.963955:0:7405:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff8c7aad23da80 version 8 rpc_version 8 00000020:00100000:1.0:1787096280.963982:0:7405:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787096280.963988:0:7405:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c7983a68e00 x1873906084465920/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787096280.964000:0:7405:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7983a68e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7405:1873906084465920:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787096280.964029:0:7405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096280.964047:0:7405:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c7ab3f50f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787096280.964104:0:7980:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084465920 00000100:00100000:0.0:1787096280.964111:0:7980:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084465920 00000100:00100000:0.0:1787096280.964144:0:7980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787096280.964152:0:7980:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983a69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+11:7405:x1873906084465920:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787096280.964679:0:7980:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983a69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:7405:x1873906084465920:12345-0@lo:1000:osp_up0-1.0 Request processed in 526us (646us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1787096280.964690:0:7980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1787096280.964747:0:7405:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7983a68e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7405:1873906084465920:0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1787096280.964854:0:8384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a813eda00/0x9eebb2eb7f50d9fd lrc: 3/0,1 mode: --/PW res: [0x240000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.964868:0:8384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a813eda00/0x9eebb2eb7f50d9fd lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.964880:0:8384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a813eda00/0x9eebb2eb7f50d9fd lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.964900:0:8384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a813ec600/0x9eebb2eb7f50da04 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.964907:0:8384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a813ec600/0x9eebb2eb7f50da04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.964912:0:8384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a813ec600/0x9eebb2eb7f50da04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.964933:0:8384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a813ed200/0x9eebb2eb7f50da0b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.964938:0:8384:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a813ed200/0x9eebb2eb7f50da0b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.964951:0:8384:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a813ed200/0x9eebb2eb7f50da0b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096280.964965:0:8384:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7a879f1500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8384:1873906084466048:0@lo:101:mdt00_003.0 00000100:00100000:2.0:1787096280.964992:0:8384:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096280.965014:0:8384:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c79831d7540 going to sleep for 11 seconds 00000100:00100000:1.0:1787096280.965036:0:7407:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084466048 00000100:00100000:1.0:1787096280.965041:0:7407:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084466048 00000100:00100000:1.0:1787096280.965076:0:7407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1787096280.965084:0:7407:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983923480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:8384:x1873906084466048:12345-0@lo:101:mdt00_003.0 00010000:00010000:1.0:1787096280.965096:0:7407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096280.965108:0:7407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881c00/0x9eebb2eb7f50da12 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9eebb2eb7f50da0b expref: -99 pid: 7407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.965127:0:7407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881c00/0x9eebb2eb7f50da12 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x9eebb2eb7f50da0b expref: 13 pid: 7407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.965135:0:7407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881c00/0x9eebb2eb7f50da12 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x9eebb2eb7f50da0b expref: 13 pid: 7407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.965141:0:7407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8c7a8b27a300) 00010000:00010000:1.0:1787096280.965149:0:7407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096280.965152:0:7407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7983881c00, rc 0) 00000100:00100000:1.0:1787096280.965200:0:7407:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983923480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+13:8384:x1873906084466048:12345-0@lo:101:mdt00_003.0 Request processed in 117us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096280.965207:0:7407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787096280.965243:0:8384:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7a879f1500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8384:1873906084466048:0@lo:101:mdt00_003.0 00010000:00010000:2.0:1787096280.965256:0:8384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a813ed200/0x9eebb2eb7f50da0b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x9eebb2eb7f50da12 expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.965264:0:8384:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a813ed200/0x9eebb2eb7f50da0b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x9eebb2eb7f50da12 expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787096280.965280:0:8384:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000005b961928 reply state 0000000054d95cf4 transno 4294967314 ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a813ec600/0x9eebb2eb7f50da04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.965289:0:8384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a813ec600/0x9eebb2eb7f50da04 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.965295:0:8384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x6:0x0].0x0 (ffff8c7aadca8d00) 00010000:00010000:2.0:1787096280.965298:0:8384:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787096280.965300:0:8384:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787096280.965306:0:8384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a813ed200/0x9eebb2eb7f50da0b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x9eebb2eb7f50da12 expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.965312:0:8384:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a813ed200/0x9eebb2eb7f50da0b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x9eebb2eb7f50da12 expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787096280.965320:0:8384:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000401:0x6:0x0] 00000004:00010000:2.0:1787096280.965334:0:8384:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000005b961928 reply state 0000000054d95cf4 transno 4294967314 ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a813eda00/0x9eebb2eb7f50d9fd lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.965341:0:8384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a813eda00/0x9eebb2eb7f50d9fd lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.965345:0:8384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x4:0x0].0x0 (ffff8c7aadca8c00) 00010000:00010000:2.0:1787096280.965347:0:8384:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787096280.965348:0:8384:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:2.0:1787096280.965351:0:8384:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000402:0x4:0x0]: returning size 4096 00000004:00080000:2.0:1787096280.965384:0:8384:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1787096280.965401:0:8384:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a813ed800/0x9eebb2eb7f50d9e1 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x9eebb2eb7f50d9e8 expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.965410:0:8384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a813ed800/0x9eebb2eb7f50d9e1 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x9eebb2eb7f50d9e8 expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.965417:0:8384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a813ed800/0x9eebb2eb7f50d9e1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x9eebb2eb7f50d9e8 expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.965438:0:8384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1787096280.965441:0:8384:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1787096280.965451:0:8384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7983880c00/0x9eebb2eb7f50d9ef lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x9eebb2eb7f50d9f6 expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.965471:0:8384:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7983880c00/0x9eebb2eb7f50d9ef lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x9eebb2eb7f50d9f6 expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.965495:0:8374:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787096280.965501:0:8374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a813ed800/0x9eebb2eb7f50d9e1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x9eebb2eb7f50d9e8 expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.965509:0:8374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7a813ed800 already unused, calling callback (ffffffffc1765ee0) 00010000:00010000:1.0:1787096280.965515:0:8374:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a813ed800/0x9eebb2eb7f50d9e1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x9eebb2eb7f50d9e8 expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787096280.965522:0:8374:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a813ed800/0x9eebb2eb7f50d9e1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x9eebb2eb7f50d9e8 expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096280.965533:0:8384:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983387100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9858421-28a9-4744-99eb-72e5bedc52c4+26:34937:x1873906077065472:12345-192.168.201.52@tcp:36:lfs.0 Request processed in 7948us (8104us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1787096280.965551:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 184 00010000:00010000:1.0:1787096280.965552:0:8374:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a813ed800/0x9eebb2eb7f50d9e1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x9eebb2eb7f50d9e8 expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.965558:0:8374:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787096280.965586:0:8374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a813ed800/0x9eebb2eb7f50d9e1 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x9eebb2eb7f50d9e8 expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.965593:0:8374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a813ed800/0x9eebb2eb7f50d9e1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x9eebb2eb7f50d9e8 expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.965609:0:8374:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787096280.965614:0:8374:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787096280.965617:0:8374:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787096280.965712:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7983a6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1873906084466176:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787096280.965753:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096280.965799:0:6464:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084466176 00000100:00100000:2.0:1787096280.965805:0:6464:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084466176 00000100:00100000:2.0:1787096280.965872:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787096280.965890:0:6464:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983a68380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+13:3628:x1873906084466176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787096280.965900:0:6464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787096280.965912:0:6464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880e00/0x9eebb2eb7f50d9e8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x9eebb2eb7f50d9e1 expref: 13 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.965924:0:6464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c7a92c71300) 00010000:00010000:2.0:1787096280.965928:0:6464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787096280.965969:0:6464:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983a68380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+12:3628:x1873906084466176:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096280.965978:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787096280.966012:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7983a6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1873906084466176:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787096280.974975:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1787096280.975012:0:10275:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077065728 00000100:00100000:3.0:1787096280.975018:0:10275:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077065728 00000100:00100000:3.0:1787096280.975052:0:10275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 185 00000100:00100000:3.0:1787096280.975059:0:10275:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7ab3ebbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9858421-28a9-4744-99eb-72e5bedc52c4+5:34940:x1873906077065728:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:3.0:1787096280.975070:0:10275:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787096280.975086:0:10275:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebac00/0x9eebb2eb7f50da19 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ef7bc65b7b41170 expref: -99 pid: 10275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096280.975125:0:10275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebaa00/0x9eebb2eb7f50da20 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096280.975132:0:10275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebaa00/0x9eebb2eb7f50da20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096280.975139:0:10275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebaa00/0x9eebb2eb7f50da20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787096280.975159:0:10275:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787096280.975162:0:10275:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787096280.975174:0:10275:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebaa00/0x9eebb2eb7f50da20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096280.975189:0:10275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebac00/0x9eebb2eb7f50da19 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41170 expref: 7 pid: 10275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096280.975200:0:10275:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebaa00/0x9eebb2eb7f50da20 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41170 expref: 6 pid: 10275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096280.975205:0:10275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c7a92c71300) 00010000:00010000:3.0:1787096280.975207:0:10275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787096280.975209:0:10275:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7a82ebaa00, rc 0) 00000100:00100000:3.0:1787096280.975241:0:10275:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7ab3ebbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9858421-28a9-4744-99eb-72e5bedc52c4+6:34940:x1873906077065728:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 183us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096280.975245:0:10275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 185 00000100:00100000:2.0:1787096280.976093:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1787096280.976137:0:6478:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077065856 00000100:00100000:1.0:1787096280.976148:0:6478:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077065856 00000100:00100000:1.0:1787096280.976192:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 186 00000100:00100000:1.0:1787096280.976200:0:6478:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a879f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9858421-28a9-4744-99eb-72e5bedc52c4+6:34940:x1873906077065856:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:1.0:1787096280.976213:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096280.976225:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881200/0x9eebb2eb7f50da27 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ef7bc65b7b41177 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.976283:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881e00/0x9eebb2eb7f50da2e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.976297:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881e00/0x9eebb2eb7f50da2e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.976306:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881e00/0x9eebb2eb7f50da2e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.976314:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880600/0x9eebb2eb7f50da35 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb790e34b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.976322:0:6478:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881600/0x9eebb2eb7f50d9f6 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x9eebb2eb7f50d9ef expref: 11 pid: 7407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.976328:0:6478:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880600/0x9eebb2eb7f50da35 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.976351:0:6478:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881600/0x9eebb2eb7f50d9f6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x9eebb2eb7f50d9ef expref: 11 pid: 7407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096280.976418:0:6478:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7983a6b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6478:1873906084466304:0@lo:104: 00000100:00100000:1.0:1787096280.976475:0:6478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096280.976521:0:7399:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084466304 00000100:00100000:1.0:1787096280.976525:0:6478:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c7ab3f50f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787096280.976534:0:7399:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084466304 00000100:00100000:3.0:1787096280.976569:0:7399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787096280.976581:0:7399:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983a69180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6478:x1873906084466304:12345-0@lo:104: 00010000:00010000:3.0:1787096280.976593:0:7399:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7983880c00/0x9eebb2eb7f50d9ef lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x9eebb2eb7f50d9f6 expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096280.976644:0:7399:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787096280.976649:0:7399:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983a69180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6478:x1873906084466304:12345-0@lo:104: Request processed in 73us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096280.976658:0:7399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:0.0:1787096280.976667:0:6465:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1787096280.976673:0:6478:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7983a6b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6478:1873906084466304:0@lo:104: 00010000:00010000:0.0:1787096280.976678:0:6465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7983880c00/0x9eebb2eb7f50d9ef lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x9eebb2eb7f50d9f6 expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.976688:0:6465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7983880c00 already unused, calling callback (ffffffffc1765ee0) 00010000:00010000:1.0:1787096280.976691:0:6478:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880600/0x9eebb2eb7f50da35 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.976694:0:6465:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7983880c00/0x9eebb2eb7f50d9ef lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x9eebb2eb7f50d9f6 expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787096280.976708:0:6465:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7983880c00/0x9eebb2eb7f50d9ef lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x9eebb2eb7f50d9f6 expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.976731:0:6465:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7983880c00/0x9eebb2eb7f50d9ef lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x9eebb2eb7f50d9f6 expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.976742:0:6465:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787096280.976768:0:6465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7983880c00/0x9eebb2eb7f50d9ef lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x9eebb2eb7f50d9f6 expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.976774:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7983880c00/0x9eebb2eb7f50d9ef lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x9eebb2eb7f50d9f6 expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.976790:0:6465:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787096280.976794:0:6465:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787096280.976795:0:3629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7ab3ebb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1873906084466432:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787096280.976798:0:6465:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787096280.976831:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096280.976868:0:7401:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084466432 00000100:00100000:0.0:1787096280.976873:0:7401:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084466432 00010000:00010000:0.0:1787096280.976890:0:7401:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881600/0x9eebb2eb7f50d9f6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x9eebb2eb7f50d9ef expref: 12 pid: 7407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096280.976915:0:7401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787096280.976924:0:7401:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983a6b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+12:3629:x1873906084466432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787096280.976931:0:7401:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:2.0:1787096280.978475:0:6456:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967365 is committed 00010000:00010000:0.0:1787096280.978539:0:7401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881600/0x9eebb2eb7f50d9f6 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x9eebb2eb7f50d9ef expref: 10 pid: 7407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.978551:0:7401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb790e34b (ffff8c7a8b27a900) 00010000:00010000:0.0:1787096280.978555:0:7401:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880600/0x9eebb2eb7f50da35 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.978561:0:7401:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880600/0x9eebb2eb7f50da35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.978575:0:7401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880600/0x9eebb2eb7f50da35 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.978595:0:7401:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787096280.978627:0:6478:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880600/0x9eebb2eb7f50da35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096280.978638:0:7401:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983a6b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+9:3629:x1873906084466432:12345-0@lo:103:ldlm_bl.0 Request processed in 1715us (1804us total) trans 0 rc 0/0 00010000:00010000:1.0:1787096280.978640:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880600/0x9eebb2eb7f50da35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096280.978653:0:7401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787096280.978671:0:3629:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7ab3ebb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1873906084466432:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787096280.978735:0:6478:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7983a6ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6478:1873906084466560:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787096280.978763:0:6478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096280.978784:0:6478:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c7ab3f50000 going to sleep for 11 seconds 00000100:00100000:0.0:1787096280.978802:0:6482:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084466560 00000100:00100000:0.0:1787096280.978807:0:6482:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084466560 00000100:00100000:0.0:1787096280.978833:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1787096280.978839:0:6482:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983a68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6478:x1873906084466560:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787096280.978893:0:6482:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983a68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6478:x1873906084466560:12345-0@lo:1000:mdt00_002.0 Request processed in 54us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096280.978899:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1787096280.978922:0:6478:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7983a6ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6478:1873906084466560:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1787096280.978966:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880e00/0x9eebb2eb7f50da3c lrc: 3/1,0 mode: --/PR res: [0x240000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.978974:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880e00/0x9eebb2eb7f50da3c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.978979:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880e00/0x9eebb2eb7f50da3c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787096280.979004:0:6478:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880e00/0x9eebb2eb7f50da3c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.979014:0:6478:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881e00/0x9eebb2eb7f50da2e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.979019:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881e00/0x9eebb2eb7f50da2e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.979024:0:6478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881e00/0x9eebb2eb7f50da2e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.979028:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881e00/0x9eebb2eb7f50da2e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.979031:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7983881e00 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:1.0:1787096280.979034:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881e00/0x9eebb2eb7f50da2e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.979039:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881e00/0x9eebb2eb7f50da2e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.979046:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c7a92c71300) 00010000:00010000:1.0:1787096280.979048:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096280.979051:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881e00/0x9eebb2eb7f50da2e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.979055:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881e00/0x9eebb2eb7f50da2e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.979063:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880600/0x9eebb2eb7f50da35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.979072:0:6478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880600/0x9eebb2eb7f50da35 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.979076:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880600/0x9eebb2eb7f50da35 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.979079:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7983880600 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:1.0:1787096280.979081:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880600/0x9eebb2eb7f50da35 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.979085:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880600/0x9eebb2eb7f50da35 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.979090:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb790e34b (ffff8c7a8b27a900) 00010000:00010000:1.0:1787096280.979091:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096280.979093:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880600/0x9eebb2eb7f50da35 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.979096:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880600/0x9eebb2eb7f50da35 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.979132:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881200/0x9eebb2eb7f50da27 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41177 expref: 8 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.979140:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880e00/0x9eebb2eb7f50da3c lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41177 expref: 7 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.979146:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x4:0x0].0x0 (ffff8c7a8b27a400) 00010000:00010000:1.0:1787096280.979147:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787096280.979153:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7983880e00, rc 0) 00000100:00100000:1.0:1787096280.979208:0:6478:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a879f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9858421-28a9-4744-99eb-72e5bedc52c4+7:34940:x1873906077065856:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 3009us (3115us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096280.979214:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 186 00000100:00100000:0.0:1787096280.980044:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1787096280.980088:0:6477:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077065984 00000100:00100000:2.0:1787096280.980093:0:6477:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077065984 00000100:00100000:2.0:1787096280.980124:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 187 00000100:00100000:2.0:1787096280.980130:0:6477:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7ab3ebb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9858421-28a9-4744-99eb-72e5bedc52c4+26:34940:x1873906077065984:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:2.0:1787096280.980142:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096280.980151:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eb400/0x9eebb2eb7f50da43 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ef7bc65b7b4117e expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.980178:0:6477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ea400/0x9eebb2eb7f50da4a lrc: 3/1,0 mode: --/PR res: [0x240000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.980200:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ea400/0x9eebb2eb7f50da4a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.980210:0:6477:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ea400/0x9eebb2eb7f50da4a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787096280.980261:0:6477:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000402:0x4:0x0]: returning size 4096 00000004:00200000:2.0:1787096280.980266:0:6477:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1787096280.980292:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eb400/0x9eebb2eb7f50da43 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b4117e expref: 28 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.980308:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ea400/0x9eebb2eb7f50da4a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b4117e expref: 27 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.980317:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x4:0x0].0x0 (ffff8c7aadca8c00) 00010000:00010000:2.0:1787096280.980319:0:6477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:2.0:1787096280.980321:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c79830ea400, rc 0) 00000100:00100000:2.0:1787096280.980351:0:6477:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7ab3ebb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9858421-28a9-4744-99eb-72e5bedc52c4+27:34940:x1873906077065984:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 222us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096280.980393:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 187 00000100:00100000:0.0:1787096280.981175:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1787096280.981214:0:6476:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077066112 00000100:00100000:2.0:1787096280.981218:0:6476:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077066112 00000100:00100000:2.0:1787096280.981249:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 188 00000100:00100000:2.0:1787096280.981255:0:6476:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abd600700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9858421-28a9-4744-99eb-72e5bedc52c4+27:34940:x1873906077066112:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:2.0:1787096280.981263:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096280.981273:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eba00/0x9eebb2eb7f50da51 lrc: 2/0,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ef7bc65b7b41185 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.981317:0:6476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ea000/0x9eebb2eb7f50da58 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.981325:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ea000/0x9eebb2eb7f50da58 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.981331:0:6476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ea000/0x9eebb2eb7f50da58 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787096280.981348:0:6476:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000400:0x6:0x0]: returning size 4096 00000004:00200000:2.0:1787096280.981351:0:6476:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1787096280.981395:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eba00/0x9eebb2eb7f50da51 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41185 expref: 29 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.981408:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ea000/0x9eebb2eb7f50da58 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41185 expref: 28 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.981416:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x6:0x0].0x0 (ffff8c7aadca8d00) 00010000:00010000:2.0:1787096280.981418:0:6476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787096280.981421:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c79830ea000, rc 0) 00000100:00100000:2.0:1787096280.981466:0:6476:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abd600700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9858421-28a9-4744-99eb-72e5bedc52c4+28:34940:x1873906077066112:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 199us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096280.981472:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 188 00000100:00100000:0.0:1787096280.982219:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1787096280.982260:0:21727:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077066240 00000100:00100000:1.0:1787096280.982266:0:21727:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077066240 00000100:00100000:1.0:1787096280.982300:0:21727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 189 00000100:00100000:1.0:1787096280.982307:0:21727:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abd602a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f9858421-28a9-4744-99eb-72e5bedc52c4+7:34940:x1873906077066240:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:1.0:1787096280.982319:0:21727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096280.982328:0:21727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880000/0x9eebb2eb7f50da5f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ef7bc65b7b4118c expref: -99 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.982376:0:21727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881400/0x9eebb2eb7f50da66 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.982385:0:21727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881c00/0x9eebb2eb7f50da12 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x9eebb2eb7f50da0b expref: 8 pid: 7407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.982392:0:21727:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881400/0x9eebb2eb7f50da66 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.982410:0:21727:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881c00/0x9eebb2eb7f50da12 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x9eebb2eb7f50da0b expref: 8 pid: 7407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096280.982418:0:21727:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7983a6ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21727:1873906084466688:0@lo:104: 00000100:00100000:1.0:1787096280.982443:0:21727:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096280.982494:0:6461:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084466688 00000100:00100000:1.0:1787096280.982497:0:21727:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c7ab3f50f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787096280.982500:0:6461:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084466688 00000100:00100000:2.0:1787096280.982531:0:6461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787096280.982537:0:6461:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983a6b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:21727:x1873906084466688:12345-0@lo:104: 00010000:00010000:2.0:1787096280.982546:0:6461:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a813ed200/0x9eebb2eb7f50da0b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x9eebb2eb7f50da12 expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.982595:0:6461:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787096280.982600:0:6461:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983a6b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:21727:x1873906084466688:12345-0@lo:104: Request processed in 64us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096280.982606:0:6461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00010000:3.0:1787096280.982632:0:7400:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787096280.982638:0:7400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a813ed200/0x9eebb2eb7f50da0b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x9eebb2eb7f50da12 expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096280.982640:0:21727:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7983a6ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21727:1873906084466688:0@lo:104: 00010000:00010000:3.0:1787096280.982665:0:7400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7a813ed200 already unused, calling callback (ffffffffc1765ee0) 00010000:00010000:3.0:1787096280.982671:0:7400:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a813ed200/0x9eebb2eb7f50da0b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x9eebb2eb7f50da12 expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.982674:0:21727:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881400/0x9eebb2eb7f50da66 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787096280.982679:0:7400:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a813ed200/0x9eebb2eb7f50da0b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x9eebb2eb7f50da12 expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096280.982709:0:7400:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a813ed200/0x9eebb2eb7f50da0b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x9eebb2eb7f50da12 expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096280.982714:0:7400:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787096280.982739:0:7400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a813ed200/0x9eebb2eb7f50da0b lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x9eebb2eb7f50da12 expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096280.982755:0:7400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a813ed200/0x9eebb2eb7f50da0b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x9eebb2eb7f50da12 expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096280.982759:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7982f51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1873906084466816:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787096280.982779:0:7400:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787096280.982782:0:7400:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787096280.982784:0:7400:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787096280.982794:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096280.982833:0:6463:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084466816 00000100:00100000:0.0:1787096280.982839:0:6463:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084466816 00010000:00010000:0.0:1787096280.982862:0:6463:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881c00/0x9eebb2eb7f50da12 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x9eebb2eb7f50da0b expref: 9 pid: 7407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096280.982898:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787096280.982908:0:6463:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983a6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+9:3626:x1873906084466816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787096280.982920:0:6463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787096280.983177:0:6463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881c00/0x9eebb2eb7f50da12 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x9eebb2eb7f50da0b expref: 9 pid: 7407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.983200:0:6463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8c7a8b27a300) 00010000:00010000:0.0:1787096280.983204:0:6463:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881400/0x9eebb2eb7f50da66 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.983211:0:6463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881400/0x9eebb2eb7f50da66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.983215:0:6463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881400/0x9eebb2eb7f50da66 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096280.983236:0:6463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787096280.983268:0:21727:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881400/0x9eebb2eb7f50da66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096280.983278:0:6463:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983a6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+8:3626:x1873906084466816:12345-0@lo:103:ldlm_bl.0 Request processed in 371us (481us total) trans 0 rc 0/0 00010000:00010000:1.0:1787096280.983297:0:21727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881400/0x9eebb2eb7f50da66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096280.983298:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787096280.983315:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7982f51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1873906084466816:0@lo:103:ldlm_bl.0 00000004:00200000:1.0:1787096280.983350:0:21727:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x6:0x0]: returning size 4096 00000004:00200000:1.0:1787096280.983394:0:21727:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1787096280.983423:0:21727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880000/0x9eebb2eb7f50da5f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b4118c expref: 9 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.983436:0:21727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881400/0x9eebb2eb7f50da66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b4118c expref: 8 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.983442:0:21727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8c7a8b27a300) 00010000:00010000:1.0:1787096280.983444:0:21727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787096280.983446:0:21727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7983881400, rc 0) 00000100:00100000:1.0:1787096280.983493:0:21727:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abd602a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f9858421-28a9-4744-99eb-72e5bedc52c4+8:34940:x1873906077066240:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 1186us (1275us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096280.983499:0:21727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 189 00000100:00100000:0.0:1787096280.984317:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1787096280.984399:0:8384:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077066368 00000100:00100000:2.0:1787096280.984405:0:8384:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077066368 00000100:00100000:2.0:1787096280.984476:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 190 00000100:00100000:2.0:1787096280.984488:0:8384:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983885500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9858421-28a9-4744-99eb-72e5bedc52c4+28:34940:x1873906077066368:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:2.0:1787096280.984497:0:8384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096280.984505:0:8384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ea800/0x9eebb2eb7f50da6d lrc: 2/0,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ef7bc65b7b41193 expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.984534:0:8384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eb000/0x9eebb2eb7f50da74 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.984541:0:8384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eb000/0x9eebb2eb7f50da74 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.984547:0:8384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eb000/0x9eebb2eb7f50da74 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.985670:0:8384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eba00/0x9eebb2eb7f50da7b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.985681:0:8384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eba00/0x9eebb2eb7f50da7b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.985704:0:8384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eba00/0x9eebb2eb7f50da7b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.985749:0:8384:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eb000/0x9eebb2eb7f50da74 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.985759:0:8384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eb000/0x9eebb2eb7f50da74 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.985767:0:8384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eb000/0x9eebb2eb7f50da74 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.985775:0:8384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eb000/0x9eebb2eb7f50da74 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.985781:0:8384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c79830eb000 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:2.0:1787096280.985786:0:8384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eb000/0x9eebb2eb7f50da74 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.985793:0:8384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eb000/0x9eebb2eb7f50da74 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.985805:0:8384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x6:0x0].0x0 (ffff8c7aadca8d00) 00010000:00010000:2.0:1787096280.985809:0:8384:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096280.985813:0:8384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eb000/0x9eebb2eb7f50da74 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.985820:0:8384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eb000/0x9eebb2eb7f50da74 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.985831:0:8384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eba00/0x9eebb2eb7f50da7b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.985847:0:8384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eba00/0x9eebb2eb7f50da7b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.985854:0:8384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eba00/0x9eebb2eb7f50da7b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.985859:0:8384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c79830eba00 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:2.0:1787096280.985863:0:8384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eba00/0x9eebb2eb7f50da7b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.985870:0:8384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eba00/0x9eebb2eb7f50da7b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.985877:0:8384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x6:0x0].0xdd5a5043 (ffff8c7a86975200) 00010000:00010000:2.0:1787096280.985879:0:8384:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096280.985881:0:8384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eba00/0x9eebb2eb7f50da7b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.985886:0:8384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eba00/0x9eebb2eb7f50da7b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.985906:0:8384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ea800/0x9eebb2eb7f50da6d lrc: 1/0,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41193 expref: 29 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.985912:0:8384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x6:0x0].0x0 (ffff8c7aadca8d00) 00010000:00010000:2.0:1787096280.985913:0:8384:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096280.985916:0:8384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ea800/0x9eebb2eb7f50da6d lrc: 0/0,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41193 expref: 29 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.985922:0:8384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c79830ea800, rc 0) 00000100:00100000:2.0:1787096280.985959:0:8384:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983885500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9858421-28a9-4744-99eb-72e5bedc52c4+28:34940:x1873906077066368:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 1476us (1642us total) trans 0 rc 301/301 00000100:00100000:2.0:1787096280.985965:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 190 00000100:00100000:0.0:1787096280.987351:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1787096280.987432:0:10275:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077066624 00000100:00100000:3.0:1787096280.987439:0:10275:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077066624 00000100:00100000:3.0:1787096280.987504:0:10275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 191 00000100:00100000:3.0:1787096280.987510:0:10275:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abd5eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9858421-28a9-4744-99eb-72e5bedc52c4+28:34940:x1873906077066624:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:3.0:1787096280.987518:0:10275:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787096280.987520:0:10275:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787096280.987530:0:10275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ea000/0x9eebb2eb7f50da58 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41185 expref: 28 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096280.987541:0:10275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x6:0x0].0x0 (ffff8c7aadca8d00) 00010000:00010000:3.0:1787096280.987544:0:10275:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787096280.987550:0:10275:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebac00/0x9eebb2eb7f50da82 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ef7bc65b7b4119a expref: -99 pid: 10275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096280.987600:0:10275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb800/0x9eebb2eb7f50da89 lrc: 3/0,1 mode: --/CW res: [0x240000400:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096280.987607:0:10275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb800/0x9eebb2eb7f50da89 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096280.987613:0:10275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb800/0x9eebb2eb7f50da89 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096280.987628:0:10275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb400/0x9eebb2eb7f50da90 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096280.987634:0:10275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb400/0x9eebb2eb7f50da90 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096280.987638:0:10275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb400/0x9eebb2eb7f50da90 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096280.987748:0:10275:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7982f53b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:10275:1873906084466944:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787096280.987782:0:10275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096280.987803:0:10275:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c798323e540 going to sleep for 11 seconds 00000100:00100000:0.0:1787096280.987850:0:6481:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084466944 00000100:00100000:0.0:1787096280.987856:0:6481:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084466944 00000100:00100000:0.0:1787096280.987887:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1787096280.987893:0:6481:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7982f50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:10275:x1873906084466944:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1787096280.987954:0:6481:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7982f50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:10275:x1873906084466944:12345-0@lo:1000:mdt00_004.0 Request processed in 61us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096280.987960:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1787096280.987979:0:10275:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967365 gen 2 00000004:00080000:3.0:1787096280.987985:0:10275:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967364 committed transno 4294967365 00000004:00080000:3.0:1787096280.988003:0:10275:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967365 committed transno 4294967365 00000100:00100000:3.0:1787096280.988018:0:10275:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7982f53b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:10275:1873906084466944:0@lo:1000:mdt00_004.0 00010000:00010000:3.0:1787096280.988336:0:10275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82eba400/0x9eebb2eb7f50da97 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096280.988343:0:10275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82eba400/0x9eebb2eb7f50da97 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096280.988348:0:10275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82eba400/0x9eebb2eb7f50da97 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787096280.988355:0:10275:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000402:0x5:0x0]: returning size 0 00010000:00010000:3.0:1787096280.988375:0:10275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb800/0x9eebb2eb7f50da89 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096280.988380:0:10275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb800/0x9eebb2eb7f50da89 lrc: 2/0,0 mode: CW/CW res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096280.988429:0:10275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb800/0x9eebb2eb7f50da89 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096280.988433:0:10275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7a82ebb800 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:3.0:1787096280.988436:0:10275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb800/0x9eebb2eb7f50da89 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096280.988440:0:10275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb800/0x9eebb2eb7f50da89 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096280.988446:0:10275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x6:0x0].0x0 (ffff8c7aadca8d00) 00010000:00010000:3.0:1787096280.988448:0:10275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096280.988450:0:10275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb800/0x9eebb2eb7f50da89 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096280.988468:0:10275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb800/0x9eebb2eb7f50da89 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787096280.988478:0:10275:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000004fa6a500 reply state 00000000de3db102 transno 4294967315 ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb400/0x9eebb2eb7f50da90 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096280.988488:0:10275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb400/0x9eebb2eb7f50da90 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096280.988492:0:10275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x6:0x0].0xdd5a5043 (ffff8c7aadca5b00) 00010000:00010000:3.0:1787096280.988494:0:10275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787096280.988496:0:10275:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787096280.988513:0:10275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebac00/0x9eebb2eb7f50da82 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b4119a expref: 30 pid: 10275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096280.988520:0:10275:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82eba400/0x9eebb2eb7f50da97 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b4119a expref: 29 pid: 10275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096280.988531:0:10275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x5:0x0].0x0 (ffff8c7aadca5300) 00010000:00010000:3.0:1787096280.988533:0:10275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787096280.988535:0:10275:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7a82eba400, rc 0) 00000100:00100000:3.0:1787096280.988562:0:10275:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abd5eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9858421-28a9-4744-99eb-72e5bedc52c4+30:34940:x1873906077066624:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 1053us (1213us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1787096280.988567:0:10275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 191 00000100:00100000:0.0:1787096280.989634:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1787096280.989670:0:6478:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077066880 00000100:00100000:2.0:1787096280.989676:0:6478:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077066880 00000100:00100000:2.0:1787096280.989708:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 192 00000100:00100000:2.0:1787096280.989715:0:6478:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abd5e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9858421-28a9-4744-99eb-72e5bedc52c4+30:34940:x1873906077066880:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:2.0:1787096280.989726:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096280.989735:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eb400/0x9eebb2eb7f50daa5 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ef7bc65b7b411a1 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.989782:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eac00/0x9eebb2eb7f50daac lrc: 3/0,1 mode: --/EX res: [0x240000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.989792:0:6478:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82eba400/0x9eebb2eb7f50da97 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b4119a expref: 31 pid: 10275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.989800:0:6478:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eac00/0x9eebb2eb7f50daac lrc: 4/0,1 mode: --/EX res: [0x240000402:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.989819:0:6478:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82eba400/0x9eebb2eb7f50da97 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b4119a expref: 31 pid: 10275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.989831:0:6478:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82eba400/0x9eebb2eb7f50da97 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b4119a expref: 31 pid: 10275 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096280.989840:0:6478:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7a883f4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6478:1873906084467072:192.168.201.52@tcp:104: 00000100:00100000:2.0:1787096280.989897:0:6478:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c79831d73c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787096280.990766:0:6478:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7a883f4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6478:1873906084467072:192.168.201.52@tcp:104: 00010000:00010000:2.0:1787096280.990782:0:6478:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eac00/0x9eebb2eb7f50daac lrc: 3/0,1 mode: --/EX res: [0x240000402:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096280.990999:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1787096280.991068:0:10225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077067008 00000100:00100000:1.0:1787096280.991079:0:10225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077067008 00010000:00010000:1.0:1787096280.991120:0:10225:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82eba400/0x9eebb2eb7f50da97 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b4119a expref: 32 pid: 10275 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096280.991154:0:10225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 68 00000100:00100000:1.0:1787096280.991175:0:10225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abd5e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f9858421-28a9-4744-99eb-72e5bedc52c4+32:2407:x1873906077067008:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787096280.991199:0:10225:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787096280.991204:0:10225:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82eba400/0x9eebb2eb7f50da97 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b4119a expref: 32 pid: 10275 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.991214:0:10225:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82eba400/0x9eebb2eb7f50da97 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b4119a expref: 32 pid: 10275 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.991231:0:10225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82eba400/0x9eebb2eb7f50da97 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b4119a expref: 32 pid: 10275 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.991244:0:10225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x5:0x0].0x0 (ffff8c7aadca5300) 00010000:00010000:1.0:1787096280.991248:0:10225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eac00/0x9eebb2eb7f50daac lrc: 3/0,1 mode: --/EX res: [0x240000402:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.991255:0:10225:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eac00/0x9eebb2eb7f50daac lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.991261:0:10225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eac00/0x9eebb2eb7f50daac lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096280.991301:0:10225:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787096280.991324:0:6478:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eac00/0x9eebb2eb7f50daac lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.991335:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eac00/0x9eebb2eb7f50daac lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787096280.991347:0:6478:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000402:0x5:0x0]: returning size 0 00000100:00100000:1.0:1787096280.991350:0:10225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abd5e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f9858421-28a9-4744-99eb-72e5bedc52c4+31:2407:x1873906077067008:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 176us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096280.991412:0:10225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 68 00010000:00010000:2.0:1787096280.991532:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eac00/0x9eebb2eb7f50daac lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.991541:0:6478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eac00/0x9eebb2eb7f50daac lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.991549:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eac00/0x9eebb2eb7f50daac lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.991555:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c79830eac00 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:2.0:1787096280.991558:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eac00/0x9eebb2eb7f50daac lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.991565:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eac00/0x9eebb2eb7f50daac lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.991578:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x5:0x0].0x0 (ffff8c7aadca5300) 00010000:00010000:2.0:1787096280.991581:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787096280.991585:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eac00/0x9eebb2eb7f50daac lrc: 2/0,0 mode: --/EX res: [0x240000402:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.991592:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eac00/0x9eebb2eb7f50daac lrc: 0/0,0 mode: --/EX res: [0x240000402:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.991620:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eb400/0x9eebb2eb7f50daa5 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b411a1 expref: 30 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.991627:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x5:0x0].0x0 (ffff8c7aadca5300) 00010000:00010000:2.0:1787096280.991628:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787096280.991631:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eb400/0x9eebb2eb7f50daa5 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b411a1 expref: 30 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096280.991640:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c79830eb400, rc 0) 00000100:00100000:2.0:1787096280.991672:0:6478:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abd5e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9858421-28a9-4744-99eb-72e5bedc52c4+29:34940:x1873906077066880:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 1958us (2039us total) trans 0 rc 301/301 00000100:00100000:2.0:1787096280.991678:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 192 00000100:00100000:0.0:1787096280.992706:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1787096280.992748:0:14257:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077067264 00000100:00100000:1.0:1787096280.992753:0:14257:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077067264 00000100:00100000:1.0:1787096280.992784:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 31 00000100:00100000:1.0:1787096280.992798:0:14257:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a87945880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f9858421-28a9-4744-99eb-72e5bedc52c4+29:34940:x1873906077067264:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:1.0:1787096280.992974:0:14257:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a87945880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f9858421-28a9-4744-99eb-72e5bedc52c4+30:34940:x1873906077067264:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 176us (268us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1787096280.992980:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 31 00000001:02000400:0.0:1787096281.444334:0:22302:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-ec test_23c: @@@@@@ FAIL: setstripe failed 00000100:00100000:0.0:1787096281.584515:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787096281.584528:0:3629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7982f53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1873906084467584:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787096281.584528:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7a883f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1873906084467456:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787096281.584532:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7a87944a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1873906084467200:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787096281.584609:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096281.584679:0:10997:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084467584 00000100:00100000:3.0:1787096281.584685:0:3629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7abd440e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3629:1873906084468096:0@lo:400:kworker.0 00000100:00100000:2.0:1787096281.584687:0:10997:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084467584 00000100:00100000:1.0:1787096281.584696:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7983384e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3627:1873906084467840:0@lo:400:kworker.0 00000100:00100000:3.0:1787096281.584713:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096281.584735:0:3629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7983342a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3629:1873906084468608:0@lo:400:kworker.0 00000100:00100000:1.0:1787096281.584750:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096281.584759:0:10997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787096281.584771:0:10997:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7982f52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1873906084467584:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787096281.584788:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096281.584802:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7983330000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3627:1873906084468352:0@lo:400:kworker.0 00000100:00100000:3.0:1787096281.584822:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7983a68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1873906084467328:0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787096281.584825:0:10997:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787096281.584848:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096281.584880:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7ab4f31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1873906084468864:0@lo:400:kworker.0 00000100:00100000:3.0:1787096281.584883:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096281.584899:0:10997:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7982f52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1873906084467584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 129us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096281.584910:0:10997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787096281.584912:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7983a6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:36cee2c3-5860-4e4f-81d9-386cc3395e70:3626:1873906084467712:0@lo:400:kworker.0 00000100:00100000:1.0:1787096281.584931:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096281.584933:0:10997:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084467200 00000100:00100000:2.0:1787096281.584938:0:10997:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084467200 00000100:00100000:3.0:1787096281.584954:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096281.584970:0:10997:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084467328 00000100:00100000:2.0:1787096281.584974:0:10997:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084467328 00000100:00100000:1.0:1787096281.584990:0:6477:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084468096 00000100:00100000:1.0:1787096281.584997:0:6477:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084468096 00000100:00100000:3.0:1787096281.585004:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7aad0f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1873906084468224:0@lo:400:kworker.0 00000100:00100000:2.0:1787096281.585005:0:10997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787096281.585028:0:10997:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7982f50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1873906084467200:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787096281.585039:0:6477:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084467840 00002000:00000024:2.0:1787096281.585043:0:10997:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787096281.585045:0:6477:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084467840 00000100:00100000:3.0:1787096281.585048:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096281.585075:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7ab4f30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3626:1873906084468736:0@lo:400:kworker.0 00000100:00100000:1.0:1787096281.585091:0:6477:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084468352 00000100:00100000:2.0:1787096281.585097:0:10997:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7982f50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1873906084467200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096281.585097:0:6477:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084468352 00000100:00100000:2.0:1787096281.585108:0:10997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787096281.585114:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096281.585136:0:6477:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084468736 00000100:00100000:2.0:1787096281.585140:0:10997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787096281.585142:0:6477:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084468736 00000100:00100000:2.0:1787096281.585153:0:10997:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7982f51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1873906084467328:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787096281.585159:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7a87944a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1873906084467200:0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787096281.585176:0:10997:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787096281.585177:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1787096281.585192:0:6477:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7982f52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1873906084468096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096281.585193:0:6471:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084467712 00000100:00100000:3.0:1787096281.585204:0:6471:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084467712 00000100:00100000:0.0:1787096281.585214:0:8358:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084468864 00000100:00100000:0.0:1787096281.585220:0:8358:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084468864 00000100:00100000:2.0:1787096281.585230:0:10997:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7982f51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1873906084467328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096281.585241:0:10997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787096281.585247:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1787096281.585259:0:6471:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a88503050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36cee2c3-5860-4e4f-81d9-386cc3395e70+23:3626:x1873906084467712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096281.585260:0:6477:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7982f52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1873906084468096:12345-0@lo:400:kworker.0 Request processed in 68us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096281.585269:0:8358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00080000:2.0:1787096281.585271:0:6473:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787096281.585277:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00080000:2.0:1787096281.585278:0:6473:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787096281.585282:0:8358:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7aad127480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1873906084468864:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787096281.585296:0:6473:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787096281.585300:0:6473:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787096281.585307:0:6471:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a88503050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36cee2c3-5860-4e4f-81d9-386cc3395e70+23:3626:x1873906084467712:12345-0@lo:400:kworker.0 Request processed in 49us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096281.585307:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1787096281.585318:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:2.0:1787096281.585323:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1787096281.585324:0:6477:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abd60d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1873906084467840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096281.585340:0:8384:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abd60f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1873906084468352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096281.585344:0:8358:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7aad127480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1873906084468864:12345-0@lo:400:kworker.0 Request processed in 64us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096281.585379:0:8358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787096281.585386:0:10275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1787096281.585396:0:10275:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7982f51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1873906084468736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096281.585403:0:6477:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abd60d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1873906084467840:12345-0@lo:400:kworker.0 Request processed in 80us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096281.585424:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1787096281.585430:0:8384:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abd60f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1873906084468352:12345-0@lo:400:kworker.0 Request processed in 94us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096281.585437:0:7980:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084468224 00000100:00100000:3.0:1787096281.585441:0:10275:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7982f51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1873906084468736:12345-0@lo:400:kworker.0 Request processed in 46us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096281.585442:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1787096281.585443:0:7980:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084468224 00000100:00100000:3.0:1787096281.585470:0:10275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1787096281.585493:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7983384e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3627:1873906084467840:0@lo:400:kworker.0 00000100:00100000:0.0:1787096281.585500:0:7980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1787096281.585511:0:7980:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7982f53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3626:x1873906084468224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096281.585514:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7983330000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3627:1873906084468352:0@lo:400:kworker.0 00000100:00100000:2.0:1787096281.585517:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096281.585519:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787096281.585543:0:3627:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c7ab4f31500 x1873906084468864/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787096297 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787096281.585556:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7ab4f31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1873906084468864:0@lo:400:kworker.0 00000100:00100000:3.0:1787096281.585562:0:3629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7abd60c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1873906084469120:0@lo:400:kworker.0 00000100:00100000:2.0:1787096281.585569:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7a9017a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1873906084467968:0@lo:400:kworker.0 00000100:00100000:0.0:1787096281.585571:0:7980:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7982f53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3626:x1873906084468224:12345-0@lo:400:kworker.0 Request processed in 64us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096281.585581:0:7980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1787096281.585591:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096281.585616:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096281.585621:0:8359:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084469120 00000100:00100000:0.0:1787096281.585625:0:8359:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084469120 00000100:00100000:3.0:1787096281.585628:0:3629:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7982f53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1873906084467584:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787096281.585644:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7ab4f5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3628:1873906084468480:0@lo:400:kworker.0 00000100:00100000:1.0:1787096281.585647:0:7407:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084467968 00000100:00100000:1.0:1787096281.585653:0:7407:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084467968 00000100:00100000:3.0:1787096281.585654:0:3629:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7abd440e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3629:1873906084468096:0@lo:400:kworker.0 00000100:00100000:0.0:1787096281.585659:0:8359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787096281.585670:0:8359:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7982f50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3629:x1873906084469120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096281.585683:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096281.585693:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7983a6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:36cee2c3-5860-4e4f-81d9-386cc3395e70:3626:1873906084467712:0@lo:400:kworker.0 00000100:00100000:1.0:1787096281.585701:0:7407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1787096281.585707:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7aad0f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1873906084468224:0@lo:400:kworker.0 00000100:00100000:1.0:1787096281.585715:0:7407:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a883f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:3628:x1873906084467968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096281.585719:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7a878b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1873906084468992:0@lo:400:kworker.0 00000100:00100000:3.0:1787096281.585723:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7ab4f30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3626:1873906084468736:0@lo:400:kworker.0 00000100:00100000:0.0:1787096281.585729:0:8359:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7982f50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3629:x1873906084469120:12345-0@lo:400:kworker.0 Request processed in 59us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096281.585738:0:8359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00080000:3.0:1787096281.585742:0:3626:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c7983a68e00 x1873906084467328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787096297 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787096281.585754:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7983a68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1873906084467328:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787096281.585772:0:21727:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084468608 00000100:00100000:1.0:1787096281.585777:0:7407:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a883f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:3628:x1873906084467968:12345-0@lo:400:kworker.0 Request processed in 62us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096281.585778:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096281.585778:0:21727:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084468608 00000100:00100000:1.0:1787096281.585790:0:7407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00010000:00080000:3.0:1787096281.585804:0:3629:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c7abd60c000 x1873906084469120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787096297 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787096281.585824:0:3629:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7abd60c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1873906084469120:0@lo:400:kworker.0 00000100:00100000:0.0:1787096281.585825:0:21727:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084468480 00000100:00100000:0.0:1787096281.585829:0:21727:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084468480 00000100:00100000:2.0:1787096281.585833:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7a9017a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1873906084467968:0@lo:400:kworker.0 00000100:00100000:1.0:1787096281.585834:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1787096281.585849:0:6477:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7982f51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3629:x1873906084468608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096281.585863:0:21727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1787096281.585871:0:8356:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084468992 00000100:00080000:2.0:1787096281.585871:0:6473:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787096281.585877:0:8356:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084468992 00000100:00080000:2.0:1787096281.585878:0:6473:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787096281.585881:0:21727:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a883f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1873906084468480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096281.585897:0:6477:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7982f51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3629:x1873906084468608:12345-0@lo:400:kworker.0 Request processed in 51us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096281.585904:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1787096281.585910:0:10997:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084467456 00000100:00100000:3.0:1787096281.585914:0:8356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787096281.585915:0:10997:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084467456 00000100:00100000:3.0:1787096281.585924:0:8356:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a883f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1873906084468992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096281.585963:0:10997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787096281.585975:0:8356:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a883f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1873906084468992:12345-0@lo:400:kworker.0 Request processed in 52us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096281.585978:0:10997:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a883f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1873906084467456:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787096281.585992:0:8356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00002000:00000024:2.0:1787096281.585997:0:10997:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787096281.586003:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7a878b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1873906084468992:0@lo:400:kworker.0 00000100:00100000:3.0:1787096281.586039:0:3629:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7983342a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3629:1873906084468608:0@lo:400:kworker.0 00000100:00100000:2.0:1787096281.586055:0:10997:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a883f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1873906084467456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096281.586063:0:21727:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a883f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1873906084468480:12345-0@lo:400:kworker.0 Request processed in 185us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096281.586067:0:10997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787096281.586075:0:21727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1787096281.586090:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7ab4f5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3628:1873906084468480:0@lo:400:kworker.0 00010000:00080000:1.0:1787096281.586105:0:3628:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c7a883f4e00 x1873906084467456/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787096297 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787096281.586118:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7a883f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1873906084467456:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787096281.689979:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1787096281.690016:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1787096281.690038:0:10275:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077067520 00000100:00100000:0.0:1787096281.690047:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1787096281.690055:0:10275:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077067520 00000100:00100000:1.0:1787096281.690092:0:6469:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077067392 00000100:00100000:1.0:1787096281.690104:0:6469:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077067392 00000100:00100000:2.0:1787096281.690131:0:6478:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077067648 00000100:00100000:2.0:1787096281.690139:0:6478:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077067648 00000100:00100000:0.0:1787096281.690153:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 204 00000100:00100000:0.0:1787096281.690178:0:8384:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a87944e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9858421-28a9-4744-99eb-72e5bedc52c4+8:2407:x1873906077067520:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1787096281.690198:0:10275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 205 00000100:00100000:1.0:1787096281.690205:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 298 00000100:00100000:3.0:1787096281.690218:0:10275:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a87947b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9858421-28a9-4744-99eb-72e5bedc52c4+30:2406:x1873906077067648:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:1.0:1787096281.690229:0:6469:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a88500850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5469a594-d695-447b-b0fa-7bef4580840e+9:2406:x1873906077067392:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1787096281.690256:0:8384:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a87944e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9858421-28a9-4744-99eb-72e5bedc52c4+8:2407:x1873906077067520:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 92us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096281.690263:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 204 00000100:00100000:1.0:1787096281.690283:0:6469:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a88500850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5469a594-d695-447b-b0fa-7bef4580840e+9:2406:x1873906077067392:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 64us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096281.690293:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 298 00000100:00100000:3.0:1787096281.690312:0:10275:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a87947b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9858421-28a9-4744-99eb-72e5bedc52c4+30:2406:x1873906077067648:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 97us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096281.690326:0:10275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 205 00010000:00010000:1.0:1787096281.776610:0:6466:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 1487 lines, 1487 kept, 0 dropped, 0 bad.