00010000:00010000:3.0F:1787096290.993464:0:7400:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0F:1787096291.232954:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0F:1787096291.233015:0:6477:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077086592 00000100:00100000:2.0:1787096291.233036:0:6477:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077086592 00000100:00080000:0.0:1787096291.233107:0:6473:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787096291.234525:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 266 00000100:00100000:2.0:1787096291.234544:0:6477:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7ab4f74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9858421-28a9-4744-99eb-72e5bedc52c4+15:37789:x1873906077086592:12345-192.168.201.52@tcp:101:rm.0 00010000:00010000:2.0:1787096291.234572:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096291.234626:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830ebc00/0x9eebb2eb7f50e0ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ef7bc65b7b41337 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096291.235988:0:6477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830ebe00/0x9eebb2eb7f50e0f6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096291.236007:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830ebe00/0x9eebb2eb7f50e0f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096291.236023:0:6477:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830ebe00/0x9eebb2eb7f50e0f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787096291.236134:0:6477:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x17:0x0]: returning size 4096 00000004:00200000:2.0:1787096291.236138:0:6477:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:2.0:1787096291.236157:0:6477:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830ebe00/0x9eebb2eb7f50e0f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096291.236183:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830ebc00/0x9eebb2eb7f50e0ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41337 expref: 17 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096291.236201:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830ebe00/0x9eebb2eb7f50e0f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41337 expref: 16 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096291.236210:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x17:0x0].0x0 (ffff8c7a836ec800) 00010000:00010000:2.0:1787096291.236213:0:6477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787096291.236217:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c79830ebe00, rc 0) 00000100:00100000:2.0:1787096291.236320:0:6477:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7ab4f74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9858421-28a9-4744-99eb-72e5bedc52c4+16:37789:x1873906077086592:12345-192.168.201.52@tcp:101:rm.0 Request processed in 1782us (3372us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096291.236329:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 266 00000100:00100000:0.0:1787096291.237639:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1787096291.237691:0:21727:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077086720 00000100:00100000:3.0:1787096291.237699:0:21727:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077086720 00000100:00080000:0.0:1787096291.237740:0:6473:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787096291.237756:0:21727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 267 00000100:00100000:3.0:1787096291.237768:0:21727:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7ab4f75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f9858421-28a9-4744-99eb-72e5bedc52c4+8:37789:x1873906077086720:12345-192.168.201.52@tcp:101:rm.0 00010000:00010000:3.0:1787096291.237785:0:21727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787096291.239042:0:21727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebaa00/0x9eebb2eb7f50e0fd lrc: 2/0,0 mode: --/CR res: [0x240000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ef7bc65b7b4133e expref: -99 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096291.239088:0:21727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82eba400/0x9eebb2eb7f50e104 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096291.239098:0:21727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82eba400/0x9eebb2eb7f50e104 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096291.239108:0:21727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82eba400/0x9eebb2eb7f50e104 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21727 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787096291.239134:0:21727:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000401:0x6:0x0]: returning size 4096 00000004:00200000:3.0:1787096291.239139:0:21727:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1787096291.239161:0:21727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebaa00/0x9eebb2eb7f50e0fd lrc: 0/0,0 mode: --/CR res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b4133e expref: 10 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096291.239182:0:21727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82eba400/0x9eebb2eb7f50e104 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b4133e expref: 9 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096291.239190:0:21727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x6:0x0].0x0 (ffff8c7aadca5700) 00010000:00010000:3.0:1787096291.239193:0:21727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787096291.239196:0:21727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7a82eba400, rc 0) 00000100:00100000:3.0:1787096291.239248:0:21727:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7ab4f75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f9858421-28a9-4744-99eb-72e5bedc52c4+9:37789:x1873906077086720:12345-192.168.201.52@tcp:101:rm.0 Request processed in 1484us (1610us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096291.239265:0:21727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 267 00000100:00100000:0.0:1787096291.240722:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1787096291.240812:0:6478:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077086976 00000100:00100000:2.0:1787096291.240820:0:6478:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077086976 00000100:00100000:2.0:1787096291.240863:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 268 00000100:00100000:2.0:1787096291.240872:0:6478:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7ab4f74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9858421-28a9-4744-99eb-72e5bedc52c4+16:37789:x1873906077086976:12345-192.168.201.52@tcp:101:rm.0 00010000:00010000:2.0:1787096291.240883:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096291.240894:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830ea000/0x9eebb2eb7f50e10b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ef7bc65b7b41345 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787096291.240978:0:6478:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x17:0x0]: returning size 4096 00010000:00010000:2.0:1787096291.241072:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830ea000/0x9eebb2eb7f50e10b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41345 expref: 18 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096291.241104:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c7a92c71300) 00010000:00010000:2.0:1787096291.241108:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787096291.241113:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830ea000/0x9eebb2eb7f50e10b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41345 expref: 18 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096291.241125:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c79830ea000, rc 0) 00000100:00100000:2.0:1787096291.241184:0:6478:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7ab4f74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9858421-28a9-4744-99eb-72e5bedc52c4+17:37789:x1873906077086976:12345-192.168.201.52@tcp:101:rm.0 Request processed in 313us (463us total) trans 4294967395 rc 301/301 00000100:00100000:2.0:1787096291.241191:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 268 00000100:00100000:0.0:1787096291.243765:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0F:1787096291.243806:0:6480:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077087104 00000100:00100000:1.0:1787096291.243822:0:6480:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077087104 00000100:00100000:1.0:1787096291.243885:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 52 00000100:00100000:1.0:1787096291.243900:0:6480:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7aac34c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9858421-28a9-4744-99eb-72e5bedc52c4+17:37789:x1873906077087104:12345-192.168.201.52@tcp:37:rm.0 00000100:00100000:1.0:1787096291.246333:0:6480:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7aac34c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9858421-28a9-4744-99eb-72e5bedc52c4+17:37789:x1873906077087104:12345-192.168.201.52@tcp:37:rm.0 Request processed in 2438us (2569us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096291.246340:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 52 00000100:00100000:0.0:1787096291.248871:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1787096291.248920:0:14257:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077087232 00000100:00100000:1.0:1787096291.248925:0:14257:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077087232 00000100:00100000:1.0:1787096291.248952:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 53 00000100:00100000:1.0:1787096291.248958:0:14257:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7ab4f75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f9858421-28a9-4744-99eb-72e5bedc52c4+9:37789:x1873906077087232:12345-192.168.201.52@tcp:37:rm.0 00000100:00100000:1.0:1787096291.251487:0:14257:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7ab4f75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f9858421-28a9-4744-99eb-72e5bedc52c4+9:37789:x1873906077087232:12345-192.168.201.52@tcp:37:rm.0 Request processed in 2528us (2616us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096291.251493:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 53 00000100:00100000:0.0:1787096291.253466:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1787096291.253499:0:6480:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077087488 00000100:00100000:1.0:1787096291.253504:0:6480:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077087488 00000100:00100000:1.0:1787096291.253534:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 54 00000100:00100000:1.0:1787096291.253541:0:6480:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7ab4f77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9858421-28a9-4744-99eb-72e5bedc52c4+17:37789:x1873906077087488:12345-192.168.201.52@tcp:35:rm.0 00000100:00100000:1.0:1787096291.253704:0:6480:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7ab4f77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9858421-28a9-4744-99eb-72e5bedc52c4+18:37789:x1873906077087488:12345-192.168.201.52@tcp:35:rm.0 Request processed in 163us (242us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1787096291.253711:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 54 00000100:00100000:0.0:1787096291.254997:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1787096291.255075:0:6476:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077087744 00000100:00100000:1.0:1787096291.255080:0:6476:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077087744 00000100:00100000:1.0:1787096291.255120:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 269 00000100:00100000:1.0:1787096291.255128:0:6476:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7ab4f76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9858421-28a9-4744-99eb-72e5bedc52c4+18:37789:x1873906077087744:12345-192.168.201.52@tcp:101:rm.0 00010000:00010000:1.0:1787096291.255141:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096291.255166:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6aa800/0x9eebb2eb7f50e119 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ef7bc65b7b4134c expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.255272:0:6476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6aba00/0x9eebb2eb7f50e120 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x17:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.255301:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6aba00/0x9eebb2eb7f50e120 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x17:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.255326:0:6476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6aba00/0x9eebb2eb7f50e120 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x17:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787096291.255336:0:6476:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x17:0x0]: returning size 4096 00010000:00010000:1.0:1787096291.255423:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6aa800/0x9eebb2eb7f50e119 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b4134c expref: 21 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.255446:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6aba00/0x9eebb2eb7f50e120 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x17:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b4134c expref: 20 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.255453:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x17:0x0].0x0 (ffff8c7a836ec800) 00010000:00010000:1.0:1787096291.255456:0:6476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787096291.255460:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7abd6aba00, rc 0) 00000100:00100000:1.0:1787096291.255495:0:6476:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7ab4f76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9858421-28a9-4744-99eb-72e5bedc52c4+20:37789:x1873906077087744:12345-192.168.201.52@tcp:101:rm.0 Request processed in 369us (499us total) trans 4294967397 rc 0/0 00000100:00100000:1.0:1787096291.255504:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 269 00000100:00100000:0.0:1787096291.257161:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1787096291.257219:0:10275:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077087872 00000100:00100000:2.0:1787096291.257228:0:10275:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077087872 00000100:00100000:2.0:1787096291.257349:0:10275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 270 00000100:00100000:2.0:1787096291.257396:0:10275:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7ab4f77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9858421-28a9-4744-99eb-72e5bedc52c4+20:37789:x1873906077087872:12345-192.168.201.52@tcp:41:rm.0 00000004:00000024:2.0:1787096291.257459:0:10275:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 7847059456 avail 7384014848 00000100:00100000:2.0:1787096291.257519:0:10275:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7ab4f77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9858421-28a9-4744-99eb-72e5bedc52c4+20:37789:x1873906077087872:12345-192.168.201.52@tcp:41:rm.0 Request processed in 158us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096291.257532:0:10275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 270 00000100:00100000:0.0:1787096291.258867:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1787096291.258911:0:8384:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077088000 00000100:00100000:1.0:1787096291.258918:0:8384:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077088000 00000100:00100000:1.0:1787096291.258956:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 271 00000100:00100000:1.0:1787096291.258964:0:8384:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7ab4f77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9858421-28a9-4744-99eb-72e5bedc52c4+9:37789:x1873906077088000:12345-192.168.201.52@tcp:101:rm.0 00010000:00010000:1.0:1787096291.258995:0:8384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096291.259008:0:8384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6ab600/0x9eebb2eb7f50e12e lrc: 2/0,0 mode: --/CR res: [0x240000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ef7bc65b7b41353 expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.259048:0:8384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6abe00/0x9eebb2eb7f50e135 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.259057:0:8384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6abe00/0x9eebb2eb7f50e135 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.259064:0:8384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6abe00/0x9eebb2eb7f50e135 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.259073:0:8384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6aa400/0x9eebb2eb7f50e13c lrc: 3/1,0 mode: --/PR res: [0x240000401:0x6:0x0].0x727485fe bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.259078:0:8384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6aa400/0x9eebb2eb7f50e13c lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.259084:0:8384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6aa400/0x9eebb2eb7f50e13c lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.259178:0:8384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6aa000/0x9eebb2eb7f50e143 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.259183:0:8384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6aa000/0x9eebb2eb7f50e143 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x8:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.259188:0:8384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6aa000/0x9eebb2eb7f50e143 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x8:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787096291.259212:0:8384:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000402:0x8:0x0]: returning size 0 00000004:00200000:1.0:1787096291.259221:0:8384:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787096291.259236:0:8384:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6aa000/0x9eebb2eb7f50e143 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x8:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.259245:0:8384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6aa000/0x9eebb2eb7f50e143 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.259262:0:8384:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6abe00/0x9eebb2eb7f50e135 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.259267:0:8384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6abe00/0x9eebb2eb7f50e135 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.259271:0:8384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6abe00/0x9eebb2eb7f50e135 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.259276:0:8384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6abe00/0x9eebb2eb7f50e135 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.259280:0:8384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7abd6abe00 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:1.0:1787096291.259305:0:8384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6abe00/0x9eebb2eb7f50e135 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.259311:0:8384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6abe00/0x9eebb2eb7f50e135 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.259319:0:8384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x6:0x0].0x0 (ffff8c7aadca5700) 00010000:00010000:1.0:1787096291.259321:0:8384:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096291.259336:0:8384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6abe00/0x9eebb2eb7f50e135 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.259340:0:8384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6abe00/0x9eebb2eb7f50e135 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.259388:0:8384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6aa400/0x9eebb2eb7f50e13c lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.259394:0:8384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6aa400/0x9eebb2eb7f50e13c lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.259400:0:8384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6aa400/0x9eebb2eb7f50e13c lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.259404:0:8384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7abd6aa400 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:1.0:1787096291.259408:0:8384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6aa400/0x9eebb2eb7f50e13c lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.259413:0:8384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6aa400/0x9eebb2eb7f50e13c lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.259423:0:8384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x6:0x0].0x727485fe (ffff8c7a836ec600) 00010000:00010000:1.0:1787096291.259425:0:8384:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096291.259427:0:8384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6aa400/0x9eebb2eb7f50e13c lrc: 2/0,0 mode: --/PR res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.259430:0:8384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6aa400/0x9eebb2eb7f50e13c lrc: 0/0,0 mode: --/PR res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.259450:0:8384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6ab600/0x9eebb2eb7f50e12e lrc: 0/0,0 mode: --/CR res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41353 expref: 11 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.259458:0:8384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6aa000/0x9eebb2eb7f50e143 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41353 expref: 10 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.259473:0:8384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x8:0x0].0x0 (ffff8c7982e5cb00) 00010000:00010000:1.0:1787096291.259475:0:8384:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787096291.259478:0:8384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7abd6aa000, rc 0) 00000100:00100000:1.0:1787096291.259522:0:8384:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7ab4f77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9858421-28a9-4744-99eb-72e5bedc52c4+10:37789:x1873906077088000:12345-192.168.201.52@tcp:101:rm.0 Request processed in 558us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096291.259531:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 271 00000100:00100000:0.0:1787096291.261007:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1787096291.261091:0:6477:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077088256 00000100:00100000:2.0:1787096291.261100:0:6477:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077088256 00000100:00100000:2.0:1787096291.261145:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 272 00000100:00100000:2.0:1787096291.261154:0:6477:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abd60f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9858421-28a9-4744-99eb-72e5bedc52c4+10:37789:x1873906077088256:12345-192.168.201.52@tcp:36:rm.0 00010000:00010000:2.0:1787096291.261191:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1787096291.261212:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6aa000/0x9eebb2eb7f50e143 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41353 expref: 10 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096291.261227:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x8:0x0].0x0 (ffff8c7982e5cb00) 00010000:00010000:2.0:1787096291.261242:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82eba400/0x9eebb2eb7f50e104 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b4133e expref: 9 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096291.261251:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x6:0x0].0x0 (ffff8c7aadca5700) 00010000:00010000:2.0:1787096291.261257:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787096291.261277:0:6477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ea000/0x9eebb2eb7f50e14a lrc: 3/0,1 mode: --/CW res: [0x240000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096291.261308:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ea000/0x9eebb2eb7f50e14a lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096291.261316:0:6477:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ea000/0x9eebb2eb7f50e14a lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096291.261327:0:6477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ebc00/0x9eebb2eb7f50e151 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x6:0x0].0x727485fe bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096291.261343:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ebc00/0x9eebb2eb7f50e151 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096291.261349:0:6477:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ebc00/0x9eebb2eb7f50e151 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096291.261456:0:6477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eac00/0x9eebb2eb7f50e158 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096291.261464:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eac00/0x9eebb2eb7f50e158 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096291.261474:0:6477:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eac00/0x9eebb2eb7f50e158 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096291.261658:0:6477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eb400/0x9eebb2eb7f50e15f lrc: 3/0,1 mode: --/PW res: [0x240000402:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096291.261666:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eb400/0x9eebb2eb7f50e15f lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096291.261673:0:6477:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eb400/0x9eebb2eb7f50e15f lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096291.261680:0:6477:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eb400/0x9eebb2eb7f50e15f lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096291.261687:0:6477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eb400/0x9eebb2eb7f50e15f lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096291.261692:0:6477:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eb400/0x9eebb2eb7f50e15f lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096291.261725:0:6477:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787096291.261741:0:6477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eac00/0x9eebb2eb7f50e158 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.261745:0:6466:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787096291.261748:0:6477:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eac00/0x9eebb2eb7f50e158 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.261753:0:6466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eb400/0x9eebb2eb7f50e15f lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096291.261757:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eac00/0x9eebb2eb7f50e158 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.261778:0:6466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c79830eb400 already unused, calling callback (ffffffffc0bef6f0) 00010000:00010000:2.0:1787096291.261780:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c79830eac00 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:1.0:1787096291.261784:0:6466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eb400/0x9eebb2eb7f50e15f lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096291.261786:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eac00/0x9eebb2eb7f50e158 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.261822:0:6466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eb400/0x9eebb2eb7f50e15f lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096291.261824:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eac00/0x9eebb2eb7f50e158 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.261870:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x8:0x0].0x0 (ffff8c7a836ec400) 00010000:00010000:1.0:1787096291.261874:0:6466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787096291.261878:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x8:0x0].0x0 (ffff8c7a836ec400) 00010000:00010000:1.0:1787096291.261878:0:6466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eb400/0x9eebb2eb7f50e15f lrc: 1/0,0 mode: --/PW res: [0x240000402:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096291.261891:0:6477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787096291.261903:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eac00/0x9eebb2eb7f50e158 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.261903:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eb400/0x9eebb2eb7f50e15f lrc: 0/0,0 mode: --/PW res: [0x240000402:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096291.261940:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eac00/0x9eebb2eb7f50e158 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.261945:0:6466:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787096291.261950:0:6466:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787096291.261957:0:6466:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787096291.261974:0:6477:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ea000/0x9eebb2eb7f50e14a lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096291.261980:0:6477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ea000/0x9eebb2eb7f50e14a lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096291.261984:0:6477:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ea000/0x9eebb2eb7f50e14a lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096291.261996:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ea000/0x9eebb2eb7f50e14a lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096291.262001:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c79830ea000 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:2.0:1787096291.262003:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ea000/0x9eebb2eb7f50e14a lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096291.262008:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ea000/0x9eebb2eb7f50e14a lrc: 5/0,0 mode: CW/CW res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096291.262014:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x6:0x0].0x0 (ffff8c7a836ece00) 00010000:00010000:2.0:1787096291.262016:0:6477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096291.262018:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ea000/0x9eebb2eb7f50e14a lrc: 3/0,0 mode: --/CW res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096291.262023:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ea000/0x9eebb2eb7f50e14a lrc: 0/0,0 mode: --/CW res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787096291.262033:0:6477:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000afaef8fa reply state 0000000039f50fc5 transno 4294967344 ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ebc00/0x9eebb2eb7f50e151 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096291.262045:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ebc00/0x9eebb2eb7f50e151 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096291.262051:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x6:0x0].0x727485fe (ffff8c7a836ec600) 00010000:00010000:2.0:1787096291.262053:0:6477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787096291.262056:0:6477:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787096291.262109:0:6477:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abd60f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9858421-28a9-4744-99eb-72e5bedc52c4+10:37789:x1873906077088256:12345-192.168.201.52@tcp:36:rm.0 Request processed in 955us (1102us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1787096291.262116:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 272 00000100:00100000:0.0:1787096291.263447:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1787096291.263487:0:14257:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077088512 00000100:00100000:1.0:1787096291.263500:0:14257:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077088512 00000100:00100000:1.0:1787096291.263539:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 55 00000100:00100000:1.0:1787096291.263548:0:14257:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abd60f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f9858421-28a9-4744-99eb-72e5bedc52c4+20:37789:x1873906077088512:12345-192.168.201.52@tcp:35:rm.0 00000100:00100000:1.0:1787096291.263693:0:14257:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abd60f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f9858421-28a9-4744-99eb-72e5bedc52c4+21:37789:x1873906077088512:12345-192.168.201.52@tcp:35:rm.0 Request processed in 146us (250us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1787096291.263700:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 55 00000100:00100000:0.0:1787096291.264837:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1787096291.264883:0:21727:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077088768 00000100:00100000:1.0:1787096291.264889:0:21727:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077088768 00000100:00100000:1.0:1787096291.264936:0:21727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 273 00000100:00100000:1.0:1787096291.264949:0:21727:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abd60d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f9858421-28a9-4744-99eb-72e5bedc52c4+21:37789:x1873906077088768:12345-192.168.201.52@tcp:36:rm.0 00010000:00010000:1.0:1787096291.264985:0:21727:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1787096291.265006:0:21727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6aba00/0x9eebb2eb7f50e120 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x17:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b4134c expref: 21 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.265029:0:21727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c79830ebe00/0x9eebb2eb7f50e0f6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x17:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41337 expref: 20 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.265051:0:21727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763600/0x9eebb2eb7f50e086 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x17:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b4130d expref: 19 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.265060:0:21727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x17:0x0].0x0 (ffff8c7a836ec800) 00010000:00010000:1.0:1787096291.265068:0:21727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763a00/0x9eebb2eb7f50e06a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41306 expref: 18 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.265075:0:21727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c7a92c71300) 00010000:00010000:1.0:1787096291.265078:0:21727:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787096291.265090:0:21727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6aa800/0x9eebb2eb7f50e166 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.265105:0:21727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6aa800/0x9eebb2eb7f50e166 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.265113:0:21727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6aa800/0x9eebb2eb7f50e166 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.265151:0:21727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6ab400/0x9eebb2eb7f50e16d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xebbc3de1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.265157:0:21727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6ab400/0x9eebb2eb7f50e16d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xebbc3de1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.265162:0:21727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6ab400/0x9eebb2eb7f50e16d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xebbc3de1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.265212:0:21727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6ab200/0x9eebb2eb7f50e174 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.265218:0:21727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6ab200/0x9eebb2eb7f50e174 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.265224:0:21727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6ab200/0x9eebb2eb7f50e174 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.265236:0:21727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6aaa00/0x9eebb2eb7f50e17b lrc: 3/0,1 mode: --/EX res: [0x200000400:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.265244:0:21727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763e00/0x9eebb2eb7f50e094 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41314 expref: 17 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.265250:0:21727:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6aaa00/0x9eebb2eb7f50e17b lrc: 4/0,1 mode: --/EX res: [0x200000400:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.265297:0:21727:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763e00/0x9eebb2eb7f50e094 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41314 expref: 17 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.265309:0:21727:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763e00/0x9eebb2eb7f50e094 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41314 expref: 17 pid: 21727 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096291.265323:0:21727:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7abf937800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21727:1873906084486528:192.168.201.52@tcp:104: 00000100:00100000:1.0:1787096291.265432:0:21727:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c7abd55e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787096291.266338:0:21727:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7abf937800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21727:1873906084486528:192.168.201.52@tcp:104: 00010000:00010000:1.0:1787096291.266385:0:21727:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6aaa00/0x9eebb2eb7f50e17b lrc: 3/0,1 mode: --/EX res: [0x200000400:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096291.266739:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1787096291.266860:0:8375:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077088896 00000100:00100000:3.0:1787096291.266870:0:8375:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077088896 00010000:00010000:3.0:1787096291.266909:0:8375:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763e00/0x9eebb2eb7f50e094 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41314 expref: 18 pid: 21727 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096291.266964:0:8375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 85 00000100:00100000:3.0:1787096291.266979:0:8375:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abd60ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f9858421-28a9-4744-99eb-72e5bedc52c4+18:2406:x1873906077088896:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787096291.266996:0:8375:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787096291.267005:0:8375:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763e00/0x9eebb2eb7f50e094 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41314 expref: 18 pid: 21727 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096291.267024:0:8375:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763e00/0x9eebb2eb7f50e094 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41314 expref: 18 pid: 21727 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096291.267048:0:8375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763e00/0x9eebb2eb7f50e094 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41314 expref: 18 pid: 21727 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096291.267066:0:8375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x6:0x0].0x0 (ffff8c7a836ec100) 00010000:00010000:3.0:1787096291.267073:0:8375:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6aaa00/0x9eebb2eb7f50e17b lrc: 3/0,1 mode: --/EX res: [0x200000400:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096291.267085:0:8375:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6aaa00/0x9eebb2eb7f50e17b lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096291.267095:0:8375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6aaa00/0x9eebb2eb7f50e17b lrc: 4/0,1 mode: EX/EX res: [0x200000400:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096291.267150:0:8375:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787096291.267186:0:21727:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6aaa00/0x9eebb2eb7f50e17b lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.267197:0:21727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6aaa00/0x9eebb2eb7f50e17b lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096291.267210:0:8375:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abd60ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f9858421-28a9-4744-99eb-72e5bedc52c4+17:2406:x1873906077088896:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 231us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096291.267240:0:8375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 85 00010000:00010000:1.0:1787096291.267243:0:21727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8c7abd6ab800/0x9eebb2eb7f50e182 lrc: 3/0,1 mode: --/EX res: [0x240000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.267250:0:21727:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8c7abd6ab800/0x9eebb2eb7f50e182 lrc: 3/0,1 mode: --/EX res: [0x240000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.267260:0:21727:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8c7abd6ab800/0x9eebb2eb7f50e182 lrc: 3/0,1 mode: --/EX res: [0x240000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096291.267280:0:21727:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7abf937800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:21727:1873906084486656:0@lo:101:mdt00_005.0 00000100:00100000:1.0:1787096291.267398:0:21727:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096291.267437:0:21727:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c7abd55e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787096291.267487:0:7980:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084486656 00000100:00100000:3.0:1787096291.267495:0:7980:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084486656 00000100:00100000:3.0:1787096291.267556:0:7980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1787096291.267570:0:7980:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abf936d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:21727:x1873906084486656:12345-0@lo:101:mdt00_005.0 00010000:00010000:3.0:1787096291.267587:0:7980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787096291.267607:0:7980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebaa00/0x9eebb2eb7f50e189 lrc: 2/0,0 mode: --/EX res: [0x240000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9eebb2eb7f50e182 expref: -99 pid: 7980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096291.267633:0:7980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebaa00/0x9eebb2eb7f50e189 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x9eebb2eb7f50e182 expref: 6 pid: 7980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096291.267650:0:7980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebaa00/0x9eebb2eb7f50e189 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x9eebb2eb7f50e182 expref: 6 pid: 7980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096291.267661:0:7980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x6:0x0].0x0 (ffff8c7aadca5d00) 00010000:00010000:3.0:1787096291.267665:0:7980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787096291.267670:0:7980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7a82ebaa00, rc 0) 00000100:00100000:3.0:1787096291.267733:0:7980:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abf936d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:21727:x1873906084486656:12345-0@lo:101:mdt00_005.0 Request processed in 167us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096291.267745:0:7980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1787096291.267787:0:21727:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967341 gen 2 00000004:00080000:1.0:1787096291.267796:0:21727:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967331 committed transno 4294967341 00000020:00080000:1.0:1787096291.267803:0:21727:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8c798228e600 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1787096291.267809:0:21727:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff8c7abd61ad00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8c7aa04d7540 00000020:00080000:1.0:1787096291.267813:0:21727:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].4 00000020:00080000:1.0:1787096291.267816:0:21727:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff8c7abd61a600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8c7982294600 00000020:00080000:1.0:1787096291.267820:0:21727:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].4 00000004:00080000:1.0:1787096291.267852:0:21727:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967333 committed transno 4294967341 00000004:00080000:1.0:1787096291.267864:0:21727:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967334 committed transno 4294967341 00000020:00080000:0.0:1787096291.267884:0:6508:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000004:00080000:1.0:1787096291.267885:0:21727:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967335 committed transno 4294967341 00000004:00080000:1.0:1787096291.267897:0:21727:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967341 committed transno 4294967341 00000100:00100000:1.0:1787096291.267913:0:21727:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7abf937800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:21727:1873906084486656:0@lo:101:mdt00_005.0 00010000:00010000:1.0:1787096291.267929:0:21727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8c7abd6ab800/0x9eebb2eb7f50e182 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x9eebb2eb7f50e189 expref: -99 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787096291.267953:0:6508:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:1.0:1787096291.267954:0:21727:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8c7abd6ab800/0x9eebb2eb7f50e182 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x9eebb2eb7f50e189 expref: -99 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096291.268727:0:21727:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7abf937800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:21727:1873906084486784:0@lo:403:mdt00_005.0 00000100:00100000:1.0:1787096291.268794:0:21727:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096291.268835:0:21727:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c7abd55e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787096291.268858:0:6481:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084486784 00000100:00100000:0.0:1787096291.268868:0:6481:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084486784 00000100:00100000:0.0:1787096291.268929:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1787096291.268949:0:6481:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abf934000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:21727:x1873906084486784:12345-0@lo:403:mdt00_005.0 00000100:00100000:0.0:1787096291.274774:0:6481:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abf934000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:21727:x1873906084486784:12345-0@lo:403:mdt00_005.0 Request processed in 5825us (5972us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096291.274794:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1787096291.274912:0:21727:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7abf937800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:21727:1873906084486784:0@lo:403:mdt00_005.0 00000040:00080000:0.0:1787096291.277050:0:21727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].6, 936 off42032 00000040:00080000:0.0:1787096291.277476:0:21727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].6, 1016 off42872 00000004:00080000:0.0:1787096291.277484:0:21727:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8c79831d7540 with version 12 00000004:00080000:0.0:1787096291.277516:0:7977:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff8c7a87ed4300 version 12 rpc_version 12 00000020:00100000:0.0:1787096291.277560:0:7977:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787096291.277570:0:7977:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c7abd60dc00 x1873906084487040/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 2232/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787096291.277596:0:7977:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7abd60dc00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7977:1873906084487040:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787096291.277664:0:7977:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096291.277719:0:7977:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c798228e240 going to sleep for 11 seconds 00000100:00100000:0.0:1787096291.277761:0:7407:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084487040 00000100:00100000:0.0:1787096291.277768:0:7407:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084487040 00000100:00100000:0.0:1787096291.277841:0:7407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1787096291.277859:0:7407:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7aac3cbc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7977:x1873906084487040:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787096291.278141:0:7407:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7aac3cbc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:7977:x1873906084487040:12345-0@lo:1000:osp_up1-0.0 Request processed in 285us (472us total) trans 4294967345 rc 0/0 00000100:00100000:0.0:1787096291.278150:0:7407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1787096291.278193:0:7977:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7abd60dc00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7977:1873906084487040:0@lo:1000:osp_up1-0.0 00000004:00200000:2.0:1787096291.278446:0:21727:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x17:0x0]: returning size 4096 00010000:00010000:2.0:1787096291.278466:0:21727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6aaa00/0x9eebb2eb7f50e17b lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096291.278476:0:21727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6aaa00/0x9eebb2eb7f50e17b lrc: 2/0,0 mode: EX/EX res: [0x200000400:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096291.278483:0:21727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6aaa00/0x9eebb2eb7f50e17b lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096291.278488:0:21727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7abd6aaa00 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:2.0:1787096291.278492:0:21727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6aaa00/0x9eebb2eb7f50e17b lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096291.278500:0:21727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6aaa00/0x9eebb2eb7f50e17b lrc: 4/0,0 mode: EX/EX res: [0x200000400:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096291.278511:0:21727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x6:0x0].0x0 (ffff8c7a836ec100) 00010000:00010000:2.0:1787096291.278514:0:21727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787096291.278517:0:21727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6aaa00/0x9eebb2eb7f50e17b lrc: 2/0,0 mode: --/EX res: [0x200000400:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096291.278522:0:21727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6aaa00/0x9eebb2eb7f50e17b lrc: 0/0,0 mode: --/EX res: [0x200000400:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096291.278533:0:21727:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8c7abd6ab800/0x9eebb2eb7f50e182 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x9eebb2eb7f50e189 expref: -99 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096291.278542:0:21727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8c7abd6ab800/0x9eebb2eb7f50e182 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x9eebb2eb7f50e189 expref: -99 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096291.278561:0:21727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8c7abd6ab800/0x9eebb2eb7f50e182 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x9eebb2eb7f50e189 expref: -99 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096291.278577:0:21727:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1787096291.278585:0:21727:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x6:0x0] 00010000:00010000:2.0:1787096291.278593:0:21727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6ab200/0x9eebb2eb7f50e174 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096291.278599:0:21727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6ab200/0x9eebb2eb7f50e174 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096291.278604:0:21727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6ab200/0x9eebb2eb7f50e174 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096291.278610:0:21727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7abd6ab200 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:2.0:1787096291.278614:0:21727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6ab200/0x9eebb2eb7f50e174 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096291.278617:0:8374:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787096291.278635:0:21727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6ab200/0x9eebb2eb7f50e174 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096291.278645:0:8374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8c7abd6ab800/0x9eebb2eb7f50e182 lrc: 2/0,0 mode: EX/EX res: [0x240000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x9eebb2eb7f50e189 expref: -99 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096291.278646:0:21727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x17:0x0].0x0 (ffff8c7a836ec800) 00010000:00010000:2.0:1787096291.278652:0:21727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787096291.278656:0:21727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6ab200/0x9eebb2eb7f50e174 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096291.278671:0:21727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6ab200/0x9eebb2eb7f50e174 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096291.278684:0:21727:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6aa800/0x9eebb2eb7f50e166 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096291.278693:0:8374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7abd6ab800 already unused, calling callback (ffffffffc1765ee0) 00010000:00010000:2.0:1787096291.278705:0:21727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6aa800/0x9eebb2eb7f50e166 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096291.278706:0:8374:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8c7abd6ab800/0x9eebb2eb7f50e182 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x9eebb2eb7f50e189 expref: -99 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096291.278717:0:21727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6aa800/0x9eebb2eb7f50e166 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096291.278737:0:21727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6aa800/0x9eebb2eb7f50e166 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787096291.278740:0:8374:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8c7abd6ab800/0x9eebb2eb7f50e182 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x9eebb2eb7f50e189 expref: -99 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096291.278742:0:21727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7abd6aa800 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:2.0:1787096291.278747:0:21727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6aa800/0x9eebb2eb7f50e166 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096291.278768:0:21727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6aa800/0x9eebb2eb7f50e166 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096291.278778:0:21727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c7a92c71300) 00010000:00010000:2.0:1787096291.278780:0:21727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096291.278783:0:21727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6aa800/0x9eebb2eb7f50e166 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096291.278788:0:21727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6aa800/0x9eebb2eb7f50e166 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787096291.278798:0:21727:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000b7b928f7 reply state 000000004c6a3547 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6ab400/0x9eebb2eb7f50e16d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xebbc3de1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096291.278801:0:8374:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8c7abd6ab800/0x9eebb2eb7f50e182 lrc: 2/0,0 mode: --/EX res: [0x240000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x9eebb2eb7f50e189 expref: -99 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096291.278813:0:21727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6ab400/0x9eebb2eb7f50e16d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xebbc3de1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096291.278823:0:8374:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787096291.278826:0:21727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xebbc3de1 (ffff8c7a836ec700) 00010000:00010000:2.0:1787096291.278835:0:21727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787096291.278838:0:21727:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787096291.278880:0:8374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8c7abd6ab800/0x9eebb2eb7f50e182 lrc: 1/0,0 mode: --/EX res: [0x240000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x9eebb2eb7f50e189 expref: -99 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096291.278891:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c79839bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1873906084487168:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787096291.278896:0:21727:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abd60d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f9858421-28a9-4744-99eb-72e5bedc52c4+18:37789:x1873906077088768:12345-192.168.201.52@tcp:36:rm.0 Request processed in 13947us (14057us total) trans 4294967399 rc 0/0 00010000:00010000:3.0:1787096291.278918:0:8374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8c7abd6ab800/0x9eebb2eb7f50e182 lrc: 0/0,0 mode: --/EX res: [0x240000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x9eebb2eb7f50e189 expref: -99 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096291.278921:0:21727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 273 00000100:00100000:0.0:1787096291.278970:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787096291.278973:0:8374:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787096291.278977:0:8374:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787096291.278981:0:8374:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787096291.279090:0:7401:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084487168 00000100:00100000:0.0:1787096291.279096:0:7401:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084487168 00000100:00100000:0.0:1787096291.279151:0:7401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787096291.279167:0:7401:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abd60ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+7:3628:x1873906084487168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787096291.279180:0:7401:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787096291.279207:0:7401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebaa00/0x9eebb2eb7f50e189 lrc: 0/0,0 mode: --/EX res: [0x240000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x9eebb2eb7f50e182 expref: 7 pid: 7980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096291.279239:0:7401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x6:0x0].0x0 (ffff8c7aadca5d00) 00010000:00010000:0.0:1787096291.279252:0:7401:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787096291.279329:0:7401:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abd60ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+6:3628:x1873906084487168:12345-0@lo:103:ldlm_bl.0 Request processed in 167us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096291.279413:0:7401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787096291.280208:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c79839bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1873906084487168:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787096291.824584:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7abd5c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1873906084487552:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787096291.824610:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7abd60d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1873906084487680:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787096291.824688:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096291.824692:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7abf935f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3628:1873906084487808:0@lo:400:kworker.0 00000100:00100000:1.0:1787096291.824711:0:3629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7abf935880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:36cee2c3-5860-4e4f-81d9-386cc3395e70:3629:1873906084487424:0@lo:400:kworker.0 00000100:00100000:2.0:1787096291.824737:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096291.824781:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096291.824783:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7abf935500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3628:1873906084488320:0@lo:400:kworker.0 00000100:00100000:3.0:1787096291.824787:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7abf934e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3627:1873906084488192:0@lo:400:kworker.0 00000100:00100000:1.0:1787096291.824825:0:3629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c79839bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1873906084487936:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787096291.824829:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096291.824852:0:8360:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084487680 00000100:00100000:3.0:1787096291.824861:0:8360:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084487680 00000100:00100000:2.0:1787096291.824871:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7abf935180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1873906084488832:0@lo:400:kworker.0 00000100:00100000:1.0:1787096291.824887:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096291.824921:0:3629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7abf934a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3629:1873906084488448:0@lo:400:kworker.0 00000100:00100000:2.0:1787096291.824922:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096291.824931:0:8360:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084487936 00000100:00100000:3.0:1787096291.824934:0:8360:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084487936 00000100:00080000:0.0:1787096291.824943:0:6473:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787096291.824954:0:6473:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787096291.824974:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096291.824981:0:8360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787096291.824988:0:6478:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084487808 00000100:00100000:3.0:1787096291.824992:0:8360:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c79839bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1873906084487680:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787096291.824995:0:6478:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084487808 00000100:00100000:0.0:1787096291.825010:0:8359:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084488832 00000100:00100000:1.0:1787096291.825018:0:3629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7abf937b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1873906084488960:0@lo:400:kworker.0 00000100:00100000:0.0:1787096291.825018:0:8359:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084488832 00002000:00000024:3.0:1787096291.825028:0:8360:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787096291.825034:0:6478:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084488320 00000100:00100000:2.0:1787096291.825039:0:6478:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084488320 00000100:00100000:1.0:1787096291.825061:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096291.825096:0:6478:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084488448 00000100:00100000:3.0:1787096291.825108:0:8360:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c79839bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1873906084487680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 113us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096291.825108:0:6478:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084488448 00000100:00100000:0.0:1787096291.825111:0:8359:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084488960 00000100:00100000:3.0:1787096291.825121:0:8360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787096291.825123:0:8359:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084488960 00000100:00100000:1.0:1787096291.825135:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1787096291.825153:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1787096291.825154:0:6476:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abd5c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1873906084487808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096291.825158:0:8360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787096291.825167:0:6478:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abd5c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1873906084488320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096291.825171:0:8360:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abf936a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1873906084487936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787096291.825198:0:8360:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787096291.825233:0:6476:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abd5c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1873906084487808:12345-0@lo:400:kworker.0 Request processed in 91us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096291.825244:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1787096291.825255:0:6478:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abd5c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1873906084488320:12345-0@lo:400:kworker.0 Request processed in 90us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096291.825264:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1787096291.825299:0:8360:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abf936a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1873906084487936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096291.825301:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1787096291.825311:0:8360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787096291.825335:0:6476:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abf936d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1873906084488448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096291.825339:0:8359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787096291.825357:0:8359:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abd5c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1873906084488832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096291.825395:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096291.825409:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7abf935f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3628:1873906084487808:0@lo:400:kworker.0 00000100:00100000:3.0:1787096291.825420:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c79839bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1873906084487296:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787096291.825429:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7abf935500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3628:1873906084488320:0@lo:400:kworker.0 00000100:00100000:1.0:1787096291.825441:0:6476:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abf936d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1873906084488448:12345-0@lo:400:kworker.0 Request processed in 126us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096291.825455:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1787096291.825461:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096291.825475:0:8359:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abd5c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1873906084488832:12345-0@lo:400:kworker.0 Request processed in 121us (552us total) trans 0 rc 0/0 00010000:00080000:2.0:1787096291.825493:0:3628:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c7abf935180 x1873906084488832/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787096307 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787096291.825493:0:8359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787096291.825496:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7abf936680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1873906084488064:0@lo:400:kworker.0 00000100:00100000:1.0:1787096291.825515:0:8358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787096291.825517:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7abf935180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1873906084488832:0@lo:400:kworker.0 00000100:00100000:1.0:1787096291.825533:0:8358:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abf934000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3629:x1873906084488960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096291.825543:0:8361:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084487552 00000100:00100000:0.0:1787096291.825548:0:8361:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084487552 00000100:00100000:3.0:1787096291.825552:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096291.825574:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096291.825585:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7abf935c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3626:1873906084488576:0@lo:400:kworker.0 00000100:00100000:0.0:1787096291.825589:0:8361:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084487296 00000100:00100000:0.0:1787096291.825593:0:8361:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084487296 00000100:00100000:2.0:1787096291.825610:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7abf937100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3627:1873906084488704:0@lo:400:kworker.0 00000100:00100000:1.0:1787096291.825624:0:8358:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abf934000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3629:x1873906084488960:12345-0@lo:400:kworker.0 Request processed in 92us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096291.825636:0:8361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787096291.825639:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096291.825644:0:6478:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084488192 00000100:00100000:2.0:1787096291.825653:0:6478:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084488192 00000100:00100000:0.0:1787096291.825663:0:8361:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c79839bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1873906084487552:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787096291.825666:0:8358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787096291.825680:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7abf934700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1873906084489088:0@lo:400:kworker.0 00002000:00000024:0.0:1787096291.825680:0:8361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787096291.825684:0:6478:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084488576 00000100:00100000:2.0:1787096291.825690:0:6478:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084488576 00000100:00100000:1.0:1787096291.825729:0:6471:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084487424 00000100:00100000:1.0:1787096291.825737:0:6471:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084487424 00000100:00100000:2.0:1787096291.825743:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1787096291.825744:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096291.825751:0:8361:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c79839bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1873906084487552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096291.825765:0:8361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787096291.825768:0:6478:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abd5c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1873906084488192:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1787096291.825800:0:3626:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c7abd5c0380 x1873906084487552/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787096307 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787096291.825810:0:8361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787096291.825814:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1787096291.825822:0:6478:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abd5c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1873906084488192:12345-0@lo:400:kworker.0 Request processed in 59us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096291.825835:0:8361:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c79839bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1873906084487296:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787096291.825843:0:6471:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a88503450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36cee2c3-5860-4e4f-81d9-386cc3395e70+23:3629:x1873906084487424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096291.825846:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7abd5c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1873906084487552:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787096291.825856:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00002000:00000024:0.0:1787096291.825867:0:8361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787096291.825887:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1787096291.825899:0:6478:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c79839bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1873906084488576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096291.825908:0:6482:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084488064 00000100:00100000:3.0:1787096291.825920:0:6482:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084488064 00000100:00100000:0.0:1787096291.825937:0:8361:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c79839bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1873906084487296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096291.825946:0:6471:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a88503450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36cee2c3-5860-4e4f-81d9-386cc3395e70+23:3629:x1873906084487424:12345-0@lo:400:kworker.0 Request processed in 107us (1165us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096291.825953:0:6478:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c79839bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1873906084488576:12345-0@lo:400:kworker.0 Request processed in 58us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096291.825965:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1787096291.825983:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1787096291.825988:0:6482:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c79839bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:3626:x1873906084488064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096291.825994:0:8361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787096291.826000:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1787096291.826037:0:3629:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7abf935880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:36cee2c3-5860-4e4f-81d9-386cc3395e70:3629:1873906084487424:0@lo:400:kworker.0 00000100:00100000:0.0:1787096291.826044:0:9453:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084489088 00000100:00100000:0.0:1787096291.826049:0:9453:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084489088 00010000:00080000:2.0:1787096291.826061:0:3629:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c79839bdc00 x1873906084487936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787096307 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787096291.826064:0:6482:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c79839bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:3626:x1873906084488064:12345-0@lo:400:kworker.0 Request processed in 80us (512us total) trans 0 rc 0/0 00000100:00080000:1.0:1787096291.826081:0:6473:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787096291.826087:0:3629:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c79839bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1873906084487936:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787096291.826091:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1787096291.826091:0:9453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00080000:1.0:1787096291.826094:0:6473:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787096291.826110:0:6473:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787096291.826118:0:6473:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787096291.826118:0:9453:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c79839bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3626:x1873906084489088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096291.826128:0:3629:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7abf934a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3629:1873906084488448:0@lo:400:kworker.0 00000100:00100000:2.0:1787096291.826153:0:3629:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7abf937b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1873906084488960:0@lo:400:kworker.0 00000100:00100000:3.0:1787096291.826185:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096291.826192:0:9453:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c79839bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3626:x1873906084489088:12345-0@lo:400:kworker.0 Request processed in 76us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096291.826199:0:9453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787096291.826239:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7abf936300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1873906084489216:0@lo:400:kworker.0 00000100:00100000:1.0:1787096291.826246:0:6476:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084488704 00000100:00100000:1.0:1787096291.826255:0:6476:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084488704 00000100:00100000:2.0:1787096291.826259:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7abf936680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1873906084488064:0@lo:400:kworker.0 00000100:00100000:3.0:1787096291.826290:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096291.826297:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7abf935c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3626:1873906084488576:0@lo:400:kworker.0 00010000:00080000:2.0:1787096291.826333:0:3626:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c7abf934700 x1873906084489088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787096307 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787096291.826335:0:6473:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787096291.826350:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1787096291.826377:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7abd60d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1873906084487680:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787096291.826389:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7abf934700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1873906084489088:0@lo:400:kworker.0 00000100:00100000:3.0:1787096291.826404:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7abf934e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3627:1873906084488192:0@lo:400:kworker.0 00000100:00100000:1.0:1787096291.826405:0:6476:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c79839bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1873906084488704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096291.826418:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c79839bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1873906084487296:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787096291.826434:0:8358:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084489216 00000100:00100000:3.0:1787096291.826437:0:8358:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084489216 00000100:00100000:3.0:1787096291.826465:0:8358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787096291.826470:0:6476:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c79839bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1873906084488704:12345-0@lo:400:kworker.0 Request processed in 69us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096291.826476:0:8358:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c79839bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1873906084489216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096291.826488:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1787096291.826524:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7abf937100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3627:1873906084488704:0@lo:400:kworker.0 00000100:00100000:3.0:1787096291.826531:0:8358:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c79839bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1873906084489216:12345-0@lo:400:kworker.0 Request processed in 53us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096291.826541:0:8358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787096291.826551:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7abf936300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1873906084489216:0@lo:400:kworker.0 00000001:02000400:2.0:1787096291.891984:0:23482:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 26b: EC data integrity with patterned data and 4M stripes ========================================================== 19:38:10 (1787096290) 00000100:00100000:0.0:1787096291.929967:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1787096291.930013:0:6469:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077089024 00000100:00100000:2.0:1787096291.930026:0:6469:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077089024 00000100:00100000:2.0:1787096291.930090:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 302 00000100:00100000:2.0:1787096291.930101:0:6469:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a88502c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5469a594-d695-447b-b0fa-7bef4580840e+9:2408:x1873906077089024:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1787096291.930182:0:6469:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a88502c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5469a594-d695-447b-b0fa-7bef4580840e+9:2408:x1873906077089024:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 85us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096291.930190:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 302 00000100:00100000:2.0:1787096291.947515:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1787096291.947572:0:21727:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077089152 00000100:00100000:0.0:1787096291.947585:0:21727:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077089152 00000100:00100000:0.0:1787096291.947651:0:21727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 274 00000100:00100000:0.0:1787096291.947666:0:21727:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abd5c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f9858421-28a9-4744-99eb-72e5bedc52c4+18:37958:x1873906077089152:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:0.0:1787096291.947693:0:21727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787096291.947715:0:21727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763c00/0x9eebb2eb7f50e190 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ef7bc65b7b4135a expref: -99 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096291.947789:0:21727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763000/0x9eebb2eb7f50e197 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096291.947805:0:21727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763000/0x9eebb2eb7f50e197 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096291.947817:0:21727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763000/0x9eebb2eb7f50e197 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787096291.947877:0:21727:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787096291.947882:0:21727:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787096291.947904:0:21727:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763000/0x9eebb2eb7f50e197 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096291.947936:0:21727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763c00/0x9eebb2eb7f50e190 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b4135a expref: 20 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096291.947956:0:21727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763000/0x9eebb2eb7f50e197 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b4135a expref: 19 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096291.947966:0:21727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c7a92c71300) 00010000:00010000:0.0:1787096291.947969:0:21727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787096291.947973:0:21727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7abd763000, rc 0) 00000100:00100000:0.0:1787096291.948046:0:21727:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abd5c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f9858421-28a9-4744-99eb-72e5bedc52c4+19:37958:x1873906077089152:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 383us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096291.948055:0:21727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 274 00000100:00100000:2.0:1787096291.949306:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1787096291.949387:0:10275:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077089280 00000100:00100000:1.0:1787096291.949395:0:10275:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077089280 00000100:00100000:1.0:1787096291.949454:0:10275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 275 00000100:00100000:1.0:1787096291.949473:0:10275:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abd5c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9858421-28a9-4744-99eb-72e5bedc52c4+19:37958:x1873906077089280:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:1.0:1787096291.949499:0:10275:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096291.949518:0:10275:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6aa200/0x9eebb2eb7f50e19e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ef7bc65b7b41361 expref: -99 pid: 10275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.949575:0:10275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6abc00/0x9eebb2eb7f50e1a5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.949587:0:10275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6abc00/0x9eebb2eb7f50e1a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.949609:0:10275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6abc00/0x9eebb2eb7f50e1a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.950859:0:10275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6abe00/0x9eebb2eb7f50e1ac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x67f1858 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.950875:0:10275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6abe00/0x9eebb2eb7f50e1ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.950887:0:10275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6abe00/0x9eebb2eb7f50e1ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.950924:0:10275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6abc00/0x9eebb2eb7f50e1a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.950930:0:10275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6abc00/0x9eebb2eb7f50e1a5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.950936:0:10275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6abc00/0x9eebb2eb7f50e1a5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.950941:0:10275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7abd6abc00 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:1.0:1787096291.950946:0:10275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6abc00/0x9eebb2eb7f50e1a5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.950953:0:10275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6abc00/0x9eebb2eb7f50e1a5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.950964:0:10275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c7a92c71300) 00010000:00010000:1.0:1787096291.950967:0:10275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096291.950972:0:10275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6abc00/0x9eebb2eb7f50e1a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.950977:0:10275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6abc00/0x9eebb2eb7f50e1a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.950997:0:10275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6abe00/0x9eebb2eb7f50e1ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.951001:0:10275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6abe00/0x9eebb2eb7f50e1ac lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.951006:0:10275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6abe00/0x9eebb2eb7f50e1ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.951010:0:10275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7abd6abe00 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:1.0:1787096291.951013:0:10275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6abe00/0x9eebb2eb7f50e1ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.951018:0:10275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6abe00/0x9eebb2eb7f50e1ac lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.951027:0:10275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x67f1858 (ffff8c7982e5c800) 00010000:00010000:1.0:1787096291.951030:0:10275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096291.951032:0:10275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6abe00/0x9eebb2eb7f50e1ac lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.951037:0:10275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6abe00/0x9eebb2eb7f50e1ac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.951077:0:10275:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6aa200/0x9eebb2eb7f50e19e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41361 expref: 20 pid: 10275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.951087:0:10275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c7a92c71300) 00010000:00010000:1.0:1787096291.951089:0:10275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096291.951100:0:10275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6aa200/0x9eebb2eb7f50e19e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41361 expref: 20 pid: 10275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.951117:0:10275:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7abd6aa200, rc 0) 00000100:00100000:1.0:1787096291.951169:0:10275:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abd5c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9858421-28a9-4744-99eb-72e5bedc52c4+19:37958:x1873906077089280:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 1705us (1862us total) trans 0 rc 301/301 00000100:00100000:1.0:1787096291.951180:0:10275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 275 00000100:00100000:2.0:1787096291.952889:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1787096291.952948:0:6478:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077089536 00000100:00100000:0.0:1787096291.952956:0:6478:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077089536 00000100:00100000:0.0:1787096291.952996:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 276 00000100:00100000:0.0:1787096291.953004:0:6478:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abd5c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9858421-28a9-4744-99eb-72e5bedc52c4+19:37958:x1873906077089536:12345-192.168.201.52@tcp:36:lfs.0 00010000:00010000:0.0:1787096291.953037:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787096291.953048:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763000/0x9eebb2eb7f50e197 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b4135a expref: 19 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096291.953059:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c7a92c71300) 00010000:00010000:0.0:1787096291.953069:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787096291.953099:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762200/0x9eebb2eb7f50e1b3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096291.953115:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762200/0x9eebb2eb7f50e1b3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096291.953121:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762200/0x9eebb2eb7f50e1b3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096291.953130:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762800/0x9eebb2eb7f50e1ba lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x67f1858 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096291.953134:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762800/0x9eebb2eb7f50e1ba lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096291.953138:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762800/0x9eebb2eb7f50e1ba lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787096291.953795:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].7, 2152 off44184 00000040:00080000:0.0:1787096291.953851:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].7, 2352 off45224 00000004:00080000:0.0:1787096291.953855:0:6478:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8c7a901ee840 with version 13 00000004:00080000:2.0:1787096291.953934:0:7977:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff8c7a87ed4300 version 13 rpc_version 13 00000020:00100000:2.0:1787096291.953973:0:7977:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787096291.953981:0:7977:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c7abd5c0000 x1873906084489472/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3960/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787096291.954003:0:7977:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7abd5c0000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7977:1873906084489472:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787096291.954058:0:7977:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096291.954107:0:7977:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c7a90d88600 going to sleep for 11 seconds 00000100:00100000:3.0:1787096291.954108:0:7980:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084489472 00000100:00100000:3.0:1787096291.954116:0:7980:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084489472 00000100:00100000:3.0:1787096291.954159:0:7980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1787096291.954173:0:7980:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abd5c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:7977:x1873906084489472:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787096291.954736:0:7980:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abd5c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+7:7977:x1873906084489472:12345-0@lo:1000:osp_up1-0.0 Request processed in 567us (675us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1787096291.954745:0:7980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1787096291.954833:0:7977:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7abd5c0000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7977:1873906084489472:0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1787096291.954956:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762a00/0x9eebb2eb7f50e1c1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096291.954965:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762a00/0x9eebb2eb7f50e1c1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096291.954971:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762a00/0x9eebb2eb7f50e1c1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096291.954985:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762c00/0x9eebb2eb7f50e1c8 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096291.954999:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762c00/0x9eebb2eb7f50e1c8 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096291.955004:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762c00/0x9eebb2eb7f50e1c8 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096291.955030:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8c7abd763400/0x9eebb2eb7f50e1cf lrc: 3/0,1 mode: --/PW res: [0x240000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096291.955035:0:6478:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8c7abd763400/0x9eebb2eb7f50e1cf lrc: 3/0,1 mode: --/PW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096291.955042:0:6478:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8c7abd763400/0x9eebb2eb7f50e1cf lrc: 3/0,1 mode: --/PW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096291.955059:0:6478:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7abd60c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6478:1873906084489600:0@lo:101:mdt00_002.0 00000100:00100000:0.0:1787096291.955102:0:6478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096291.955153:0:6478:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c7a855e9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787096291.955155:0:6482:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084489600 00000100:00100000:3.0:1787096291.955171:0:6482:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084489600 00000100:00100000:3.0:1787096291.955211:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1787096291.955220:0:6482:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abd60e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6478:x1873906084489600:12345-0@lo:101:mdt00_002.0 00010000:00010000:3.0:1787096291.955234:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787096291.955252:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb200/0x9eebb2eb7f50e1d6 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9eebb2eb7f50e1cf expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096291.955285:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb200/0x9eebb2eb7f50e1d6 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x9eebb2eb7f50e1cf expref: 8 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096291.955301:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb200/0x9eebb2eb7f50e1d6 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x9eebb2eb7f50e1cf expref: 8 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096291.955311:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x7:0x0].0x0 (ffff8c7aadca5900) 00010000:00010000:3.0:1787096291.955314:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096291.955318:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7a82ebb200, rc 0) 00000100:00100000:3.0:1787096291.955398:0:6482:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abd60e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6478:x1873906084489600:12345-0@lo:101:mdt00_002.0 Request processed in 179us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096291.955408:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1787096291.955434:0:6478:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7abd60c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6478:1873906084489600:0@lo:101:mdt00_002.0 00010000:00010000:0.0:1787096291.955452:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8c7abd763400/0x9eebb2eb7f50e1cf lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x9eebb2eb7f50e1d6 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096291.955463:0:6478:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8c7abd763400/0x9eebb2eb7f50e1cf lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x9eebb2eb7f50e1d6 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787096291.955483:0:6478:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000d18ff95f reply state 00000000f2cedf99 transno 4294967400 ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762c00/0x9eebb2eb7f50e1c8 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096291.955495:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762c00/0x9eebb2eb7f50e1c8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096291.955510:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x7:0x0].0x0 (ffff8c7a92c71800) 00010000:00010000:0.0:1787096291.955513:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787096291.955517:0:6478:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787096291.955522:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8c7abd763400/0x9eebb2eb7f50e1cf lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x9eebb2eb7f50e1d6 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096291.955531:0:6478:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff8c7abd763400/0x9eebb2eb7f50e1cf lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x9eebb2eb7f50e1d6 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787096291.955541:0:6478:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x7:0x0] 00000004:00010000:0.0:1787096291.955547:0:6478:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000d18ff95f reply state 00000000f2cedf99 transno 4294967400 ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762a00/0x9eebb2eb7f50e1c1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096291.955555:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762a00/0x9eebb2eb7f50e1c1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096291.955562:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8c7a92c71b00) 00010000:00010000:0.0:1787096291.955564:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787096291.955566:0:6478:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:0.0:1787096291.955569:0:6478:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x18:0x0]: returning size 4096 00010000:00010000:0.0:1787096291.955576:0:6478:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762200/0x9eebb2eb7f50e1b3 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096291.955582:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762200/0x9eebb2eb7f50e1b3 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096291.955589:0:6478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762200/0x9eebb2eb7f50e1b3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096291.955596:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762200/0x9eebb2eb7f50e1b3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096291.955612:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7abd762200 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:0.0:1787096291.955615:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762200/0x9eebb2eb7f50e1b3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096291.955622:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762200/0x9eebb2eb7f50e1b3 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096291.955632:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c7a92c71300) 00010000:00010000:0.0:1787096291.955634:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096291.955637:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762200/0x9eebb2eb7f50e1b3 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096291.955644:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762200/0x9eebb2eb7f50e1b3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787096291.955654:0:6478:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000d18ff95f reply state 00000000f2cedf99 transno 4294967400 ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762800/0x9eebb2eb7f50e1ba lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096291.955663:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762800/0x9eebb2eb7f50e1ba lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096291.955670:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x67f1858 (ffff8c7a92c71d00) 00010000:00010000:0.0:1787096291.955672:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787096291.955674:0:6478:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:0.0:1787096291.955729:0:6478:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abd5c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9858421-28a9-4744-99eb-72e5bedc52c4+20:37958:x1873906077089536:12345-192.168.201.52@tcp:36:lfs.0 Request processed in 2724us (2839us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1787096291.955737:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 276 00000100:00100000:2.0:1787096291.964836:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1787096291.964880:0:8384:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077089664 00000100:00100000:1.0:1787096291.964886:0:8384:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077089664 00000100:00100000:1.0:1787096291.964922:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 277 00000100:00100000:1.0:1787096291.964928:0:8384:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abd5c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9858421-28a9-4744-99eb-72e5bedc52c4+20:37961:x1873906077089664:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:1.0:1787096291.964940:0:8384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096291.964950:0:8384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6aa200/0x9eebb2eb7f50e1dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ef7bc65b7b41368 expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.964983:0:8384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6abe00/0x9eebb2eb7f50e1e4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.964991:0:8384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6abe00/0x9eebb2eb7f50e1e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.964998:0:8384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6abe00/0x9eebb2eb7f50e1e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787096291.965015:0:8384:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787096291.965018:0:8384:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787096291.965028:0:8384:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6abe00/0x9eebb2eb7f50e1e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.965041:0:8384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6aa200/0x9eebb2eb7f50e1dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41368 expref: 22 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.965059:0:8384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6abe00/0x9eebb2eb7f50e1e4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41368 expref: 21 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.965065:0:8384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c7a92c71300) 00010000:00010000:1.0:1787096291.965068:0:8384:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787096291.965070:0:8384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7abd6abe00, rc 0) 00000100:00100000:1.0:1787096291.965106:0:8384:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abd5c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9858421-28a9-4744-99eb-72e5bedc52c4+21:37961:x1873906077089664:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 177us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096291.965113:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 277 00000100:00100000:2.0:1787096291.966089:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1787096291.966124:0:6477:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077089792 00000100:00100000:3.0:1787096291.966130:0:6477:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077089792 00000100:00100000:3.0:1787096291.966162:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 278 00000100:00100000:3.0:1787096291.966169:0:6477:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abd5c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9858421-28a9-4744-99eb-72e5bedc52c4+21:37961:x1873906077089792:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:3.0:1787096291.966179:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787096291.966192:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebaa00/0x9eebb2eb7f50e1eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ef7bc65b7b4136f expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096291.966243:0:6477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82eba400/0x9eebb2eb7f50e1f2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096291.966262:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82eba400/0x9eebb2eb7f50e1f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096291.966287:0:6477:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82eba400/0x9eebb2eb7f50e1f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096291.966300:0:6477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebac00/0x9eebb2eb7f50e1f9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x67f1858 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096291.966310:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebac00/0x9eebb2eb7f50e1f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096291.966318:0:6477:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebac00/0x9eebb2eb7f50e1f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096291.966418:0:6477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebb400/0x9eebb2eb7f50e200 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096291.966429:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebb400/0x9eebb2eb7f50e200 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096291.966438:0:6477:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebb400/0x9eebb2eb7f50e200 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787096291.966508:0:6477:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x18:0x0]: returning size 4096 00000004:00200000:3.0:1787096291.966514:0:6477:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:3.0:1787096291.966534:0:6477:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebb400/0x9eebb2eb7f50e200 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096291.966548:0:6477:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82eba400/0x9eebb2eb7f50e1f2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096291.966568:0:6477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82eba400/0x9eebb2eb7f50e1f2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096291.966576:0:6477:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82eba400/0x9eebb2eb7f50e1f2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096291.966585:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82eba400/0x9eebb2eb7f50e1f2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096291.966592:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7a82eba400 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:3.0:1787096291.966597:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82eba400/0x9eebb2eb7f50e1f2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096291.966606:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82eba400/0x9eebb2eb7f50e1f2 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096291.966619:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c7a92c71300) 00010000:00010000:3.0:1787096291.966622:0:6477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096291.966627:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82eba400/0x9eebb2eb7f50e1f2 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096291.966635:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82eba400/0x9eebb2eb7f50e1f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096291.966650:0:6477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebac00/0x9eebb2eb7f50e1f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096291.966658:0:6477:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebac00/0x9eebb2eb7f50e1f9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096291.966665:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebac00/0x9eebb2eb7f50e1f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096291.966677:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7a82ebac00 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:3.0:1787096291.966680:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebac00/0x9eebb2eb7f50e1f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096291.966687:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebac00/0x9eebb2eb7f50e1f9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096291.966696:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x67f1858 (ffff8c7a92c71d00) 00010000:00010000:3.0:1787096291.966699:0:6477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096291.966702:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebac00/0x9eebb2eb7f50e1f9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096291.966708:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebac00/0x9eebb2eb7f50e1f9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096291.966734:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebaa00/0x9eebb2eb7f50e1eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b4136f expref: 23 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096291.966748:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a82ebb400/0x9eebb2eb7f50e200 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b4136f expref: 22 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096291.966758:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8c7a92c71b00) 00010000:00010000:3.0:1787096291.966761:0:6477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787096291.966763:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7a82ebb400, rc 0) 00000100:00100000:3.0:1787096291.966807:0:6477:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abd5c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9858421-28a9-4744-99eb-72e5bedc52c4+22:37961:x1873906077089792:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 639us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096291.966812:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 278 00000100:00100000:2.0:1787096291.967762:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1787096291.967800:0:6476:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077089920 00000100:00100000:1.0:1787096291.967805:0:6476:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077089920 00000100:00100000:1.0:1787096291.967835:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 279 00000100:00100000:1.0:1787096291.967843:0:6476:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abd5c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9858421-28a9-4744-99eb-72e5bedc52c4+22:37961:x1873906077089920:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:1.0:1787096291.967855:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096291.967865:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6abc00/0x9eebb2eb7f50e207 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ef7bc65b7b41376 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.967899:0:6476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6aa400/0x9eebb2eb7f50e20e lrc: 3/1,0 mode: --/PR res: [0x200000400:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.967907:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6aa400/0x9eebb2eb7f50e20e lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.967914:0:6476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6aa400/0x9eebb2eb7f50e20e lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787096291.967934:0:6476:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000400:0x7:0x0]: returning size 4096 00000004:00200000:1.0:1787096291.967942:0:6476:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1787096291.967962:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6abc00/0x9eebb2eb7f50e207 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41376 expref: 24 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.967972:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd6aa400/0x9eebb2eb7f50e20e lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41376 expref: 23 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.967978:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x7:0x0].0x0 (ffff8c7a92c71800) 00010000:00010000:1.0:1787096291.967980:0:6476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787096291.967982:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7abd6aa400, rc 0) 00000100:00100000:1.0:1787096291.968015:0:6476:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abd5c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9858421-28a9-4744-99eb-72e5bedc52c4+23:37961:x1873906077089920:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 173us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096291.968019:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 279 00000100:00100000:2.0:1787096291.968852:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1787096291.968930:0:21727:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077090048 00000100:00100000:0.0:1787096291.968937:0:21727:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077090048 00000100:00100000:0.0:1787096291.968979:0:21727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 280 00000100:00100000:0.0:1787096291.968994:0:21727:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983342680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f9858421-28a9-4744-99eb-72e5bedc52c4+10:37961:x1873906077090048:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:0.0:1787096291.969008:0:21727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787096291.969017:0:21727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd763000/0x9eebb2eb7f50e215 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ef7bc65b7b4137d expref: -99 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096291.969044:0:21727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd763c00/0x9eebb2eb7f50e21c lrc: 3/1,0 mode: --/PR res: [0x240000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096291.969054:0:21727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb200/0x9eebb2eb7f50e1d6 lrc: 2/0,0 mode: PW/PW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x9eebb2eb7f50e1cf expref: 7 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096291.969060:0:21727:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd763c00/0x9eebb2eb7f50e21c lrc: 4/1,0 mode: --/PR res: [0x240000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096291.969078:0:21727:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb200/0x9eebb2eb7f50e1d6 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x9eebb2eb7f50e1cf expref: 7 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096291.969086:0:21727:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7abd60c380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:21727:1873906084489728:0@lo:104: 00000100:00100000:0.0:1787096291.969115:0:21727:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096291.969151:0:21727:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c7a855e9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787096291.969170:0:7399:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084489728 00000100:00100000:3.0:1787096291.969184:0:7399:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084489728 00000100:00100000:3.0:1787096291.969227:0:7399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787096291.969238:0:7399:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abd60ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:21727:x1873906084489728:12345-0@lo:104: 00010000:00010000:3.0:1787096291.969253:0:7399:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8c7abd763400/0x9eebb2eb7f50e1cf lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x9eebb2eb7f50e1d6 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096291.969341:0:7399:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787096291.969349:0:7399:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abd60ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:21727:x1873906084489728:12345-0@lo:104: Request processed in 113us (232us total) trans 0 rc 0/0 00010000:00010000:1.0:1787096291.969378:0:6465:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1787096291.969380:0:21727:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7abd60c380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:21727:1873906084489728:0@lo:104: 00010000:00010000:1.0:1787096291.969384:0:6465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8c7abd763400/0x9eebb2eb7f50e1cf lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x9eebb2eb7f50e1d6 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.969394:0:6465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7abd763400 already unused, calling callback (ffffffffc1765ee0) 00010000:00010000:1.0:1787096291.969399:0:6465:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8c7abd763400/0x9eebb2eb7f50e1cf lrc: 4/0,0 mode: PW/PW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x9eebb2eb7f50e1d6 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096291.969400:0:21727:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd763c00/0x9eebb2eb7f50e21c lrc: 3/1,0 mode: --/PR res: [0x240000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21727 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096291.969415:0:7399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000004:00010000:1.0:1787096291.969429:0:6465:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8c7abd763400/0x9eebb2eb7f50e1cf lrc: 4/0,0 mode: PW/PW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x9eebb2eb7f50e1d6 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.969458:0:6465:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8c7abd763400/0x9eebb2eb7f50e1cf lrc: 2/0,0 mode: --/PW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x9eebb2eb7f50e1d6 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.969464:0:6465:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787096291.969493:0:6465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8c7abd763400/0x9eebb2eb7f50e1cf lrc: 1/0,0 mode: --/PW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x9eebb2eb7f50e1d6 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.969505:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8c7abd763400/0x9eebb2eb7f50e1cf lrc: 0/0,0 mode: --/PW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x9eebb2eb7f50e1d6 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096291.969509:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7abf937800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1873906084489856:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787096291.969535:0:6465:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787096291.969537:0:6465:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787096291.969541:0:6465:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787096291.969555:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096291.969591:0:10225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084489856 00000100:00100000:0.0:1787096291.969597:0:10225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084489856 00010000:00010000:0.0:1787096291.969615:0:10225:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb200/0x9eebb2eb7f50e1d6 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x9eebb2eb7f50e1cf expref: 8 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096291.969650:0:10225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787096291.969657:0:10225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983340e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+8:3628:x1873906084489856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787096291.969666:0:10225:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:1.0:1787096291.972051:0:7389:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967346 is committed 00000001:00080000:1.0:1787096291.972070:0:7389:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967344 is committed 00000020:00080000:1.0:1787096291.972078:0:7389:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0001: 7 batchid updated 00010000:00010000:3.0:1787096291.972101:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eb200/0x9eebb2eb7f50e0cc lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096291.972110:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eb200/0x9eebb2eb7f50e0cc lrc: 2/0,0 mode: TXN/TXN res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096291.972116:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eb200/0x9eebb2eb7f50e0cc lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096291.972121:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c79830eb200 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:3.0:1787096291.972124:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eb200/0x9eebb2eb7f50e0cc lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096291.972129:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eb200/0x9eebb2eb7f50e0cc lrc: 4/0,0 mode: TXN/TXN res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096291.972141:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x6:0x0].0x727485fe (ffff8c7a836ec600) 00010000:00010000:3.0:1787096291.972145:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000020:00080000:0.0:1787096291.972146:0:7414:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 7 00010000:00010000:3.0:1787096291.972148:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eb200/0x9eebb2eb7f50e0cc lrc: 2/0,0 mode: --/TXN res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096291.972164:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830eb200/0x9eebb2eb7f50e0cc lrc: 0/0,0 mode: --/TXN res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096291.972170:0:10225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7a82ebb200/0x9eebb2eb7f50e1d6 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x9eebb2eb7f50e1cf expref: 6 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096291.972181:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ebc00/0x9eebb2eb7f50e151 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096291.972184:0:10225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x7:0x0].0x0 (ffff8c7aadca5900) 00010000:00010000:3.0:1787096291.972188:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ebc00/0x9eebb2eb7f50e151 lrc: 2/0,0 mode: TXN/TXN res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096291.972189:0:10225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd763c00/0x9eebb2eb7f50e21c lrc: 3/1,0 mode: --/PR res: [0x240000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21727 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787096291.972198:0:7414:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8c7a855e9c00 with version 19 00010000:00010000:3.0:1787096291.972208:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ebc00/0x9eebb2eb7f50e151 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096291.972212:0:10225:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd763c00/0x9eebb2eb7f50e21c lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 21727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096291.972217:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c79830ebc00 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:3.0:1787096291.972222:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ebc00/0x9eebb2eb7f50e151 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096291.972223:0:10225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd763c00/0x9eebb2eb7f50e21c lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 21727 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787096291.972224:0:7414:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 7 cancel update log [0x200000401:0x3:0x0].7: rc = 0 00000004:00080000:1.0:1787096291.972240:0:7405:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff8c7aad23da80 version 19 rpc_version 19 00010000:00010000:3.0:1787096291.972255:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ebc00/0x9eebb2eb7f50e151 lrc: 4/0,0 mode: TXN/TXN res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096291.972269:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x6:0x0].0x727485fe (ffff8c7a836ec600) 00010000:00010000:3.0:1787096291.972287:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096291.972289:0:10225:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787096291.972292:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ebc00/0x9eebb2eb7f50e151 lrc: 2/0,0 mode: --/TXN res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096291.972298:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c79830ebc00/0x9eebb2eb7f50e151 lrc: 0/0,0 mode: --/TXN res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787096291.972299:0:7405:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000020:00080000:0.0:1787096291.972306:0:7414:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 7 cancel update log [0x240000400:0x3:0x0].7: rc = 0 00000100:00100000:1.0:1787096291.972328:0:7405:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c7abf937480 x1873906084490112/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00080000:0.0:1787096291.972335:0:7414:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 7 00000100:00100000:2.0:1787096291.972363:0:10225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983340e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+5:3628:x1873906084489856:12345-0@lo:103:ldlm_bl.0 Request processed in 2703us (2803us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096291.972384:0:7405:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7abf937480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7405:1873906084490112:0@lo:1000:osp_up0-1.0 00010000:00010000:0.0:1787096291.972400:0:21727:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd763c00/0x9eebb2eb7f50e21c lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21727 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096291.972406:0:10225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00010000:0.0:1787096291.972421:0:21727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd763c00/0x9eebb2eb7f50e21c lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21727 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096291.972441:0:7405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096291.972444:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7abf937800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1873906084489856:0@lo:103:ldlm_bl.0 00000004:00200000:0.0:1787096291.972450:0:21727:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000401:0x7:0x0]: returning size 4096 00000004:00200000:0.0:1787096291.972454:0:21727:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000100:00100000:1.0:1787096291.972476:0:7405:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c7a82ef1b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787096291.972487:0:7407:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084490112 00010000:00010000:0.0:1787096291.972494:0:21727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd763000/0x9eebb2eb7f50e215 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b4137d expref: 7 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096291.972495:0:7407:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084490112 00010000:00010000:0.0:1787096291.972514:0:21727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd763c00/0x9eebb2eb7f50e21c lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b4137d expref: 6 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096291.972520:0:21727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x7:0x0].0x0 (ffff8c7aadca5900) 00010000:00010000:0.0:1787096291.972523:0:21727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787096291.972525:0:21727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7abd763c00, rc 0) 00000100:00100000:2.0:1787096291.972536:0:7407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1787096291.972555:0:7407:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abf934380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:7405:x1873906084490112:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787096291.972567:0:21727:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983342680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f9858421-28a9-4744-99eb-72e5bedc52c4+6:37961:x1873906077090048:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 3573us (3715us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096291.972588:0:21727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 280 00000100:00100000:2.0:1787096291.972693:0:7407:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abf934380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:7405:x1873906084490112:12345-0@lo:1000:osp_up0-1.0 Request processed in 140us (253us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1787096291.972704:0:7407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1787096291.972726:0:7405:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7abf937480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7405:1873906084490112:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787096291.973516:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1787096291.973549:0:10275:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077090176 00000100:00100000:1.0:1787096291.973554:0:10275:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077090176 00000100:00100000:1.0:1787096291.973585:0:10275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 281 00000100:00100000:1.0:1787096291.973591:0:10275:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983340000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9858421-28a9-4744-99eb-72e5bedc52c4+6:37961:x1873906077090176:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:1.0:1787096291.973611:0:10275:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096291.973621:0:10275:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6ab600/0x9eebb2eb7f50e223 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ef7bc65b7b41384 expref: -99 pid: 10275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.973653:0:10275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6aba00/0x9eebb2eb7f50e22a lrc: 3/1,0 mode: --/CR res: [0x240000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.973666:0:10275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6aba00/0x9eebb2eb7f50e22a lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.973672:0:10275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6aba00/0x9eebb2eb7f50e22a lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.973696:0:10275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6aa800/0x9eebb2eb7f50e231 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x7:0x0].0x91dd68a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.973702:0:10275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6aa800/0x9eebb2eb7f50e231 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x7:0x0].0x91dd68a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.973708:0:10275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6aa800/0x9eebb2eb7f50e231 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x7:0x0].0x91dd68a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.973736:0:10275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6aba00/0x9eebb2eb7f50e22a lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.973741:0:10275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6aba00/0x9eebb2eb7f50e22a lrc: 2/0,0 mode: CR/CR res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.973746:0:10275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6aba00/0x9eebb2eb7f50e22a lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.973749:0:10275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7abd6aba00 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:1.0:1787096291.973752:0:10275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6aba00/0x9eebb2eb7f50e22a lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.973756:0:10275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6aba00/0x9eebb2eb7f50e22a lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.973762:0:10275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x7:0x0].0x0 (ffff8c7aadca5900) 00010000:00010000:1.0:1787096291.973768:0:10275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096291.973772:0:10275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6aba00/0x9eebb2eb7f50e22a lrc: 2/0,0 mode: --/CR res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.973777:0:10275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6aba00/0x9eebb2eb7f50e22a lrc: 0/0,0 mode: --/CR res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.973784:0:10275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6aa800/0x9eebb2eb7f50e231 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x7:0x0].0x91dd68a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.973788:0:10275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6aa800/0x9eebb2eb7f50e231 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x7:0x0].0x91dd68a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.973793:0:10275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6aa800/0x9eebb2eb7f50e231 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x7:0x0].0x91dd68a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.973796:0:10275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7abd6aa800 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:1.0:1787096291.973798:0:10275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6aa800/0x9eebb2eb7f50e231 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x7:0x0].0x91dd68a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.973801:0:10275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6aa800/0x9eebb2eb7f50e231 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x7:0x0].0x91dd68a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.973806:0:10275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x7:0x0].0x91dd68a8 (ffff8c7a8b27ad00) 00010000:00010000:1.0:1787096291.973807:0:10275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096291.973809:0:10275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6aa800/0x9eebb2eb7f50e231 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x7:0x0].0x91dd68a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.973812:0:10275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6aa800/0x9eebb2eb7f50e231 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x7:0x0].0x91dd68a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10275 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.973829:0:10275:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6ab600/0x9eebb2eb7f50e223 lrc: 1/0,0 mode: --/CR res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41384 expref: 7 pid: 10275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.973839:0:10275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x7:0x0].0x0 (ffff8c7aadca5900) 00010000:00010000:1.0:1787096291.973841:0:10275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096291.973844:0:10275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6ab600/0x9eebb2eb7f50e223 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41384 expref: 7 pid: 10275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.973850:0:10275:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7abd6ab600, rc 0) 00000100:00100000:1.0:1787096291.973880:0:10275:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983340000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9858421-28a9-4744-99eb-72e5bedc52c4+6:37961:x1873906077090176:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 289us (366us total) trans 0 rc 301/301 00000100:00100000:1.0:1787096291.973886:0:10275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 281 00000100:00100000:3.0:1787096291.974933:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1787096291.975005:0:6478:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077090432 00000100:00100000:0.0:1787096291.975010:0:6478:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077090432 00000100:00100000:0.0:1787096291.975042:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 282 00000100:00100000:0.0:1787096291.975049:0:6478:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c79839bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9858421-28a9-4744-99eb-72e5bedc52c4+6:37961:x1873906077090432:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:0.0:1787096291.975056:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787096291.975058:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787096291.975068:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd763c00/0x9eebb2eb7f50e21c lrc: 0/0,0 mode: --/PR res: [0x240000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b4137d expref: 6 pid: 21727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096291.975079:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x7:0x0].0x0 (ffff8c7aadca5900) 00010000:00010000:0.0:1787096291.975087:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787096291.975093:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd762200/0x9eebb2eb7f50e238 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ef7bc65b7b4138b expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096291.975151:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd762000/0x9eebb2eb7f50e23f lrc: 3/0,1 mode: --/CW res: [0x240000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096291.975158:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd762000/0x9eebb2eb7f50e23f lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096291.975163:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd762000/0x9eebb2eb7f50e23f lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096291.975170:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd763800/0x9eebb2eb7f50e246 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x7:0x0].0x91dd68a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096291.975175:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd763800/0x9eebb2eb7f50e246 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x7:0x0].0x91dd68a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096291.975189:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd763800/0x9eebb2eb7f50e246 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x7:0x0].0x91dd68a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096291.975481:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd762400/0x9eebb2eb7f50e24d lrc: 3/1,0 mode: --/PR res: [0x240000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096291.975488:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd762400/0x9eebb2eb7f50e24d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096291.975494:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd762400/0x9eebb2eb7f50e24d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787096291.975499:0:6478:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000402:0x9:0x0]: returning size 0 00010000:00010000:0.0:1787096291.975517:0:6478:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd762000/0x9eebb2eb7f50e23f lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096291.975521:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd762000/0x9eebb2eb7f50e23f lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096291.975525:0:6478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd762000/0x9eebb2eb7f50e23f lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096291.975529:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd762000/0x9eebb2eb7f50e23f lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096291.975532:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7abd762000 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:0.0:1787096291.975534:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd762000/0x9eebb2eb7f50e23f lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096291.975538:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd762000/0x9eebb2eb7f50e23f lrc: 5/0,0 mode: CW/CW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096291.975552:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x7:0x0].0x0 (ffff8c7a92c71100) 00010000:00010000:0.0:1787096291.975554:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096291.975556:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd762000/0x9eebb2eb7f50e23f lrc: 3/0,0 mode: --/CW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096291.975560:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd762000/0x9eebb2eb7f50e23f lrc: 0/0,0 mode: --/CW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787096291.975567:0:6478:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000001cfc2ff3 reply state 0000000095620d66 transno 4294967347 ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd763800/0x9eebb2eb7f50e246 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x7:0x0].0x91dd68a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096291.975575:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd763800/0x9eebb2eb7f50e246 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x7:0x0].0x91dd68a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096291.975579:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x7:0x0].0x91dd68a8 (ffff8c7a92c71000) 00010000:00010000:0.0:1787096291.975580:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787096291.975582:0:6478:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787096291.975599:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd762200/0x9eebb2eb7f50e238 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b4138b expref: 8 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096291.975608:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd762400/0x9eebb2eb7f50e24d lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b4138b expref: 7 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096291.975613:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x9:0x0].0x0 (ffff8c7a92c71600) 00010000:00010000:0.0:1787096291.975614:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787096291.975616:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7abd762400, rc 0) 00000100:00100000:0.0:1787096291.975648:0:6478:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c79839bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9858421-28a9-4744-99eb-72e5bedc52c4+8:37961:x1873906077090432:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 600us (718us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1787096291.975653:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 282 00000100:00100000:2.0:1787096291.976796:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1787096291.976841:0:8384:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077090688 00000100:00100000:1.0:1787096291.976847:0:8384:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077090688 00000100:00100000:1.0:1787096291.976878:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 283 00000100:00100000:1.0:1787096291.976884:0:8384:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983341180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9858421-28a9-4744-99eb-72e5bedc52c4+8:37961:x1873906077090688:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:1.0:1787096291.976894:0:8384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096291.976902:0:8384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6ab200/0x9eebb2eb7f50e25b lrc: 2/0,0 mode: --/CR res: [0x240000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ef7bc65b7b41392 expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.976944:0:8384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6aaa00/0x9eebb2eb7f50e262 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.976953:0:8384:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd762400/0x9eebb2eb7f50e24d lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b4138b expref: 9 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.976959:0:8384:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6aaa00/0x9eebb2eb7f50e262 lrc: 4/0,1 mode: --/EX res: [0x240000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.976976:0:8384:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd762400/0x9eebb2eb7f50e24d lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b4138b expref: 9 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.976992:0:8384:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd762400/0x9eebb2eb7f50e24d lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b4138b expref: 9 pid: 6478 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096291.977000:0:8384:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7abf937800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8384:1873906084490240:192.168.201.52@tcp:104: 00000100:00100000:1.0:1787096291.977044:0:8384:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c7a82ef1b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787096291.977887:0:8384:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7abf937800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8384:1873906084490240:192.168.201.52@tcp:104: 00010000:00010000:1.0:1787096291.977898:0:8384:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6aaa00/0x9eebb2eb7f50e262 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096291.978050:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1787096291.978124:0:6463:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077090816 00000100:00100000:0.0:1787096291.978140:0:6463:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077090816 00010000:00010000:0.0:1787096291.978159:0:6463:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd762400/0x9eebb2eb7f50e24d lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b4138b expref: 10 pid: 6478 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096291.978187:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 87 00000100:00100000:0.0:1787096291.978194:0:6463:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983341c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9858421-28a9-4744-99eb-72e5bedc52c4+10:2407:x1873906077090816:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787096291.978201:0:6463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787096291.978206:0:6463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd762400/0x9eebb2eb7f50e24d lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b4138b expref: 10 pid: 6478 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096291.978220:0:6463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd762400/0x9eebb2eb7f50e24d lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b4138b expref: 10 pid: 6478 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096291.978231:0:6463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd762400/0x9eebb2eb7f50e24d lrc: 0/0,0 mode: --/PR res: [0x240000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b4138b expref: 10 pid: 6478 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096291.978241:0:6463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x9:0x0].0x0 (ffff8c7a92c71600) 00010000:00010000:0.0:1787096291.978244:0:6463:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6aaa00/0x9eebb2eb7f50e262 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096291.978250:0:6463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6aaa00/0x9eebb2eb7f50e262 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096291.978255:0:6463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6aaa00/0x9eebb2eb7f50e262 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096291.978282:0:6463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787096291.978310:0:6463:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983341c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9858421-28a9-4744-99eb-72e5bedc52c4+9:2407:x1873906077090816:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 117us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096291.978322:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 87 00010000:00010000:1.0:1787096291.978439:0:8384:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6aaa00/0x9eebb2eb7f50e262 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.978445:0:8384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6aaa00/0x9eebb2eb7f50e262 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787096291.978455:0:8384:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000402:0x9:0x0]: returning size 0 00010000:00010000:1.0:1787096291.978532:0:8384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6aaa00/0x9eebb2eb7f50e262 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.978538:0:8384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6aaa00/0x9eebb2eb7f50e262 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.978542:0:8384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6aaa00/0x9eebb2eb7f50e262 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.978545:0:8384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7abd6aaa00 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:1.0:1787096291.978547:0:8384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6aaa00/0x9eebb2eb7f50e262 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.978560:0:8384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6aaa00/0x9eebb2eb7f50e262 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.978567:0:8384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x9:0x0].0x0 (ffff8c7a92c71600) 00010000:00010000:1.0:1787096291.978568:0:8384:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787096291.978570:0:8384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6aaa00/0x9eebb2eb7f50e262 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.978575:0:8384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6aaa00/0x9eebb2eb7f50e262 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8384 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.978593:0:8384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6ab200/0x9eebb2eb7f50e25b lrc: 1/0,0 mode: --/CR res: [0x240000402:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41392 expref: 8 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.978598:0:8384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x9:0x0].0x0 (ffff8c7a92c71600) 00010000:00010000:1.0:1787096291.978600:0:8384:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787096291.978602:0:8384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7abd6ab200/0x9eebb2eb7f50e25b lrc: 0/0,0 mode: --/CR res: [0x240000402:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41392 expref: 8 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096291.978610:0:8384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7abd6ab200, rc 0) 00000100:00100000:1.0:1787096291.978639:0:8384:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983341180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9858421-28a9-4744-99eb-72e5bedc52c4+7:37961:x1873906077090688:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 1755us (1844us total) trans 0 rc 301/301 00000100:00100000:1.0:1787096291.978645:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 283 00000100:00100000:2.0:1787096291.979562:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1787096291.979599:0:6480:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077091072 00000100:00100000:1.0:1787096291.979603:0:6480:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077091072 00000100:00100000:1.0:1787096291.979643:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 56 00000100:00100000:1.0:1787096291.979649:0:6480:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983341880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9858421-28a9-4744-99eb-72e5bedc52c4+7:37961:x1873906077091072:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:1.0:1787096291.979755:0:6480:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983341880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9858421-28a9-4744-99eb-72e5bedc52c4+8:37961:x1873906077091072:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 104us (208us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1787096291.979771:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 56 00010000:00010000:3.0:1787096292.016549:0:7400:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787096292.336634:0:3629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7983342300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1873906084490368:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787096292.336762:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096292.336824:0:6481:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084490368 00000100:00100000:1.0:1787096292.336837:0:6481:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084490368 00000100:00100000:1.0:1787096292.336936:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1787096292.336959:0:6481:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c79839bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1873906084490368:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787096292.337056:0:6481:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1787096292.337143:0:6481:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c79839bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1873906084490368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 193us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096292.337172:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1787096292.337238:0:3629:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967346 gen 2 00000004:00080000:3.0:1787096292.337249:0:3629:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967345 committed transno 4294967346 00000004:00080000:3.0:1787096292.337330:0:3629:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967346 committed transno 4294967346 00000100:00100000:3.0:1787096292.337418:0:3629:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7983342300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1873906084490368:0@lo:41:osp-pre-1-0.0 00000001:02000400:2.0:1787096292.509458:0:23530:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-ec test_26b: @@@@@@ FAIL: setstripe failed 00000100:00100000:3.0:1787096292.848727:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7983340700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1873906084490496:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787096292.848839:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096292.848926:0:7980:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084490496 00000100:00100000:2.0:1787096292.848941:0:7980:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084490496 00000100:00100000:2.0:1787096292.849051:0:7980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1787096292.849074:0:7980:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c79839be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+10:3626:x1873906084490496:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787096292.849156:0:7980:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446105088 avail 1299865600 00000100:00100000:2.0:1787096292.849419:0:7980:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c79839be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+10:3626:x1873906084490496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 292us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096292.849432:0:7980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1787096292.849485:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7983340700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1873906084490496:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787096293.041512:0:6466:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 1085 lines, 1085 kept, 0 dropped, 0 bad.