00010000:00010000:0.0F:1787096597.774675:0:7858:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787096598.364960:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0F:1787096598.365004:0:6488:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345526784 00000100:00100000:1.0:1787096598.365019:0:6488:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345526784 00000100:00080000:3.0F:1787096598.365063:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787096598.365090:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 266 00000100:00100000:1.0:1787096598.365103:0:6488:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742ff1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70e19547-606a-4706-b016-3476e377d7df+15:37797:x1873906345526784:12345-192.168.201.40@tcp:101:rm.0 00010000:00010000:1.0:1787096598.365122:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096598.365141:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5800/0xa979d75fc166c6b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2ded7f867b2232 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.365205:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5400/0xa979d75fc166c6bd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.365220:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5400/0xa979d75fc166c6bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.365232:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5400/0xa979d75fc166c6bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787096598.365315:0:6488:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x17:0x0]: returning size 4096 00000004:00200000:1.0:1787096598.365320:0:6488:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:1.0:1787096598.365341:0:6488:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5400/0xa979d75fc166c6bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.365366:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5800/0xa979d75fc166c6b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2232 expref: 17 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.365381:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5400/0xa979d75fc166c6bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2232 expref: 16 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.365390:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x17:0x0].0x0 (ffff961741933600) 00010000:00010000:1.0:1787096598.365394:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787096598.365397:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96186ddf5400, rc 0) 00000100:00100000:1.0:1787096598.365834:0:6488:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742ff1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70e19547-606a-4706-b016-3476e377d7df+16:37797:x1873906345526784:12345-192.168.201.40@tcp:101:rm.0 Request processed in 734us (880us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096598.365843:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 266 00000100:00100000:0.0:1787096598.367841:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1787096598.367875:0:9989:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345526912 00000100:00100000:3.0:1787096598.367882:0:9989:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345526912 00000100:00080000:0.0:1787096598.367915:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787096598.367930:0:9989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 267 00000100:00100000:3.0:1787096598.367941:0:9989:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742ff3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:70e19547-606a-4706-b016-3476e377d7df+8:37797:x1873906345526912:12345-192.168.201.40@tcp:101:rm.0 00010000:00010000:3.0:1787096598.367958:0:9989:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787096598.367972:0:9989:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff961840030800/0xa979d75fc166c6c4 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2ded7f867b2239 expref: -99 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096598.368012:0:9989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff961840030400/0xa979d75fc166c6cb lrc: 3/1,0 mode: --/PR res: [0x240000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096598.368023:0:9989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff961840030400/0xa979d75fc166c6cb lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096598.368032:0:9989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff961840030400/0xa979d75fc166c6cb lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787096598.368057:0:9989:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000401:0x6:0x0]: returning size 4096 00000004:00200000:3.0:1787096598.368062:0:9989:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1787096598.368084:0:9989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff961840030800/0xa979d75fc166c6c4 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2239 expref: 10 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096598.368099:0:9989:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff961840030400/0xa979d75fc166c6cb lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2239 expref: 9 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096598.368107:0:9989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x6:0x0].0x0 (ffff961843e27f00) 00010000:00010000:3.0:1787096598.368109:0:9989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787096598.368112:0:9989:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961840030400, rc 0) 00000100:00100000:3.0:1787096598.368150:0:9989:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742ff3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:70e19547-606a-4706-b016-3476e377d7df+9:37797:x1873906345526912:12345-192.168.201.40@tcp:101:rm.0 Request processed in 212us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096598.368167:0:9989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 267 00000100:00100000:3.0:1787096598.369367:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1787096598.369402:0:6489:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345527168 00000100:00100000:1.0:1787096598.369407:0:6489:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345527168 00000100:00100000:1.0:1787096598.369436:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 268 00000100:00100000:1.0:1787096598.369499:0:6489:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961743416a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70e19547-606a-4706-b016-3476e377d7df+16:37797:x1873906345527168:12345-192.168.201.40@tcp:101:rm.0 00010000:00010000:1.0:1787096598.369509:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096598.369518:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5c00/0xa979d75fc166c6d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2ded7f867b2240 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787096598.369613:0:6489:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x17:0x0]: returning size 4096 00010000:00010000:1.0:1787096598.369684:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5c00/0xa979d75fc166c6d2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2240 expref: 18 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.369694:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9618472ca600) 00010000:00010000:1.0:1787096598.369696:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787096598.369699:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5c00/0xa979d75fc166c6d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2240 expref: 18 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.369705:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96186ddf5c00, rc 0) 00000100:00100000:1.0:1787096598.369732:0:6489:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961743416a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70e19547-606a-4706-b016-3476e377d7df+17:37797:x1873906345527168:12345-192.168.201.40@tcp:101:rm.0 Request processed in 239us (368us total) trans 4294967394 rc 301/301 00000100:00100000:1.0:1787096598.369737:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 268 00000100:00100000:0.0:1787096598.371393:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1787096598.371434:0:13534:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345527296 00000100:00100000:3.0:1787096598.371451:0:13534:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345527296 00000100:00100000:3.0:1787096598.371504:0:13534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 52 00000100:00100000:3.0:1787096598.371514:0:13534:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96185818d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:70e19547-606a-4706-b016-3476e377d7df+17:37797:x1873906345527296:12345-192.168.201.40@tcp:37:rm.0 00000100:00100000:3.0:1787096598.373396:0:13534:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96185818d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:70e19547-606a-4706-b016-3476e377d7df+17:37797:x1873906345527296:12345-192.168.201.40@tcp:37:rm.0 Request processed in 1881us (2002us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096598.373405:0:13534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 52 00000100:00100000:0.0:1787096598.375528:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1787096598.375577:0:6492:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345527424 00000100:00100000:3.0:1787096598.375584:0:6492:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345527424 00000100:00100000:3.0:1787096598.375635:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 53 00000100:00100000:3.0:1787096598.375649:0:6492:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742ff1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70e19547-606a-4706-b016-3476e377d7df+9:37797:x1873906345527424:12345-192.168.201.40@tcp:37:rm.0 00000100:00100000:3.0:1787096598.377434:0:6492:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742ff1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70e19547-606a-4706-b016-3476e377d7df+9:37797:x1873906345527424:12345-192.168.201.40@tcp:37:rm.0 Request processed in 1790us (1909us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096598.377466:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 53 00000100:00100000:0.0:1787096598.378756:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1787096598.378790:0:13534:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345527680 00000100:00100000:3.0:1787096598.378797:0:13534:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345527680 00000100:00100000:3.0:1787096598.378835:0:13534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 54 00000100:00100000:3.0:1787096598.378846:0:13534:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742ff2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:70e19547-606a-4706-b016-3476e377d7df+17:37797:x1873906345527680:12345-192.168.201.40@tcp:35:rm.0 00000100:00100000:3.0:1787096598.378992:0:13534:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742ff2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:70e19547-606a-4706-b016-3476e377d7df+18:37797:x1873906345527680:12345-192.168.201.40@tcp:35:rm.0 Request processed in 149us (237us total) trans 4294967395 rc 0/0 00000100:00100000:3.0:1787096598.379000:0:13534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 54 00000100:00100000:0.0:1787096598.380094:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1787096598.380153:0:6488:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345527936 00000100:00100000:1.0:1787096598.380159:0:6488:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345527936 00000100:00100000:1.0:1787096598.380213:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 269 00000100:00100000:1.0:1787096598.380224:0:6488:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742ff0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70e19547-606a-4706-b016-3476e377d7df+18:37797:x1873906345527936:12345-192.168.201.40@tcp:101:rm.0 00010000:00010000:1.0:1787096598.380246:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096598.380262:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5c00/0xa979d75fc166c6e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2ded7f867b2247 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.380377:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5800/0xa979d75fc166c6e7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x17:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.380392:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5800/0xa979d75fc166c6e7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x17:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.380401:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5800/0xa979d75fc166c6e7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x17:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787096598.380411:0:6488:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x17:0x0]: returning size 4096 00010000:00010000:1.0:1787096598.380539:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5c00/0xa979d75fc166c6e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2247 expref: 21 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.380556:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5800/0xa979d75fc166c6e7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x17:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2247 expref: 20 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.380565:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x17:0x0].0x0 (ffff961741933600) 00010000:00010000:1.0:1787096598.380568:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787096598.380571:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96186ddf5800, rc 0) 00000100:00100000:1.0:1787096598.380621:0:6488:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742ff0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70e19547-606a-4706-b016-3476e377d7df+20:37797:x1873906345527936:12345-192.168.201.40@tcp:101:rm.0 Request processed in 396us (524us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1787096598.380631:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 269 00000100:00100000:0.0:1787096598.381877:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1787096598.381911:0:9989:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345528064 00000100:00100000:3.0:1787096598.381917:0:9989:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345528064 00000100:00100000:3.0:1787096598.381962:0:9989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 270 00000100:00100000:3.0:1787096598.381972:0:9989:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:70e19547-606a-4706-b016-3476e377d7df+20:37797:x1873906345528064:12345-192.168.201.40@tcp:41:rm.0 00000004:00000024:3.0:1787096598.382017:0:9989:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 7847059456 avail 7384014848 00000100:00100000:3.0:1787096598.382069:0:9989:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:70e19547-606a-4706-b016-3476e377d7df+20:37797:x1873906345528064:12345-192.168.201.40@tcp:41:rm.0 Request processed in 100us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096598.382076:0:9989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 270 00000100:00100000:0.0:1787096598.382987:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1787096598.383018:0:6489:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345528192 00000100:00100000:1.0:1787096598.383022:0:6489:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345528192 00000100:00100000:1.0:1787096598.383048:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 271 00000100:00100000:1.0:1787096598.383059:0:6489:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742ff0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70e19547-606a-4706-b016-3476e377d7df+9:37797:x1873906345528192:12345-192.168.201.40@tcp:101:rm.0 00010000:00010000:1.0:1787096598.383067:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096598.383077:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf5000/0xa979d75fc166c6f5 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2ded7f867b224e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.383119:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4400/0xa979d75fc166c6fc lrc: 3/1,0 mode: --/CR res: [0x240000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.383136:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4400/0xa979d75fc166c6fc lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.383146:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4400/0xa979d75fc166c6fc lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.383155:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf5200/0xa979d75fc166c703 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x6:0x0].0x727485fe bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.383166:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf5200/0xa979d75fc166c703 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.383170:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf5200/0xa979d75fc166c703 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.383219:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4a00/0xa979d75fc166c70a lrc: 3/1,0 mode: --/PR res: [0x240000402:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.383223:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4a00/0xa979d75fc166c70a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x8:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.383233:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4a00/0xa979d75fc166c70a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x8:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787096598.383262:0:6489:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000402:0x8:0x0]: returning size 0 00000004:00200000:1.0:1787096598.383264:0:6489:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787096598.383277:0:6489:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4a00/0xa979d75fc166c70a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x8:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.383287:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4a00/0xa979d75fc166c70a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.383301:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4400/0xa979d75fc166c6fc lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.383308:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4400/0xa979d75fc166c6fc lrc: 2/0,0 mode: CR/CR res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.383314:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4400/0xa979d75fc166c6fc lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.383320:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96186ddf4400 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:1.0:1787096598.383324:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4400/0xa979d75fc166c6fc lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.383332:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4400/0xa979d75fc166c6fc lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.383344:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x6:0x0].0x0 (ffff961843e27f00) 00010000:00010000:1.0:1787096598.383347:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096598.383350:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4400/0xa979d75fc166c6fc lrc: 2/0,0 mode: --/CR res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.383353:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4400/0xa979d75fc166c6fc lrc: 0/0,0 mode: --/CR res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.383370:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf5200/0xa979d75fc166c703 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.383374:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf5200/0xa979d75fc166c703 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.383378:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf5200/0xa979d75fc166c703 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.383381:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96186ddf5200 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:1.0:1787096598.383383:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf5200/0xa979d75fc166c703 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.383387:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf5200/0xa979d75fc166c703 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.383393:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x6:0x0].0x727485fe (ffff961741933900) 00010000:00010000:1.0:1787096598.383395:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096598.383397:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf5200/0xa979d75fc166c703 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.383400:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf5200/0xa979d75fc166c703 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.383425:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf5000/0xa979d75fc166c6f5 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b224e expref: 11 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.383459:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4a00/0xa979d75fc166c70a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b224e expref: 10 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.383476:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x8:0x0].0x0 (ffff961742a1eb00) 00010000:00010000:1.0:1787096598.383479:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787096598.383482:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96186ddf4a00, rc 0) 00000100:00100000:1.0:1787096598.383522:0:6489:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742ff0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70e19547-606a-4706-b016-3476e377d7df+10:37797:x1873906345528192:12345-192.168.201.40@tcp:101:rm.0 Request processed in 463us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096598.383527:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 271 00000100:00100000:3.0:1787096598.384715:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1787096598.384753:0:6488:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345528448 00000100:00100000:1.0:1787096598.384758:0:6488:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345528448 00000100:00100000:1.0:1787096598.384788:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 272 00000100:00100000:1.0:1787096598.384794:0:6488:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961743415c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70e19547-606a-4706-b016-3476e377d7df+10:37797:x1873906345528448:12345-192.168.201.40@tcp:36:rm.0 00010000:00010000:1.0:1787096598.384821:0:6488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1787096598.384835:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4a00/0xa979d75fc166c70a lrc: 0/0,0 mode: --/PR res: [0x240000402:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b224e expref: 10 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.384849:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x8:0x0].0x0 (ffff961742a1eb00) 00010000:00010000:1.0:1787096598.384863:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff961840030400/0xa979d75fc166c6cb lrc: 0/0,0 mode: --/PR res: [0x240000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2239 expref: 9 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.384874:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x6:0x0].0x0 (ffff961843e27f00) 00010000:00010000:1.0:1787096598.384878:0:6488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787096598.384889:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4c00/0xa979d75fc166c711 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.384896:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4c00/0xa979d75fc166c711 lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.384901:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4c00/0xa979d75fc166c711 lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.384915:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf5e00/0xa979d75fc166c718 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x6:0x0].0x727485fe bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.384923:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf5e00/0xa979d75fc166c718 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.384929:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf5e00/0xa979d75fc166c718 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.384980:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4200/0xa979d75fc166c71f lrc: 3/0,1 mode: --/EX res: [0x240000402:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.384988:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4200/0xa979d75fc166c71f lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.384995:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4200/0xa979d75fc166c71f lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.385176:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4e00/0xa979d75fc166c726 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.385185:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4e00/0xa979d75fc166c726 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.385192:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4e00/0xa979d75fc166c726 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.385200:0:6488:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4e00/0xa979d75fc166c726 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.385205:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4e00/0xa979d75fc166c726 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.385233:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4e00/0xa979d75fc166c726 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.385253:0:6488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787096598.385267:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4200/0xa979d75fc166c71f lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.385273:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4200/0xa979d75fc166c71f lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.385279:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4200/0xa979d75fc166c71f lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096598.385281:0:10297:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787096598.385287:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96186ddf4200 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:3.0:1787096598.385289:0:10297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4e00/0xa979d75fc166c726 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.385291:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4200/0xa979d75fc166c71f lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096598.385306:0:10297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96186ddf4e00 already unused, calling callback (ffffffffc0bda6f0) 00010000:00010000:1.0:1787096598.385308:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4200/0xa979d75fc166c71f lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096598.385310:0:10297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4e00/0xa979d75fc166c726 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096598.385328:0:10297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4e00/0xa979d75fc166c726 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.385328:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x8:0x0].0x0 (ffff961742a1e900) 00010000:00010000:1.0:1787096598.385335:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787096598.385339:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4200/0xa979d75fc166c71f lrc: 2/0,0 mode: --/EX res: [0x240000402:0x8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096598.385345:0:10297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x8:0x0].0x0 (ffff961742a1e900) 00010000:00010000:1.0:1787096598.385348:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4200/0xa979d75fc166c71f lrc: 0/0,0 mode: --/EX res: [0x240000402:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096598.385349:0:10297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787096598.385354:0:10297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4e00/0xa979d75fc166c726 lrc: 1/0,0 mode: --/PW res: [0x240000402:0x8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096598.385362:0:10297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4e00/0xa979d75fc166c726 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.385365:0:6488:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4c00/0xa979d75fc166c711 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.385373:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4c00/0xa979d75fc166c711 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096598.385378:0:10297:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787096598.385382:0:10297:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787096598.385385:0:10297:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787096598.385389:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4c00/0xa979d75fc166c711 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.385406:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4c00/0xa979d75fc166c711 lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.385412:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96186ddf4c00 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:1.0:1787096598.385415:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4c00/0xa979d75fc166c711 lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.385418:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4c00/0xa979d75fc166c711 lrc: 5/0,0 mode: CW/CW res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.385425:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x6:0x0].0x0 (ffff961742a1e700) 00010000:00010000:1.0:1787096598.385426:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096598.385428:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4c00/0xa979d75fc166c711 lrc: 3/0,0 mode: --/CW res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.385432:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4c00/0xa979d75fc166c711 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787096598.385477:0:6488:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000004921b88f reply state 000000007dcc107c transno 4294967344 ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf5e00/0xa979d75fc166c718 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.385487:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf5e00/0xa979d75fc166c718 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.385494:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x6:0x0].0x727485fe (ffff961741933900) 00010000:00010000:1.0:1787096598.385497:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787096598.385500:0:6488:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787096598.385561:0:6488:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961743415c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70e19547-606a-4706-b016-3476e377d7df+10:37797:x1873906345528448:12345-192.168.201.40@tcp:36:rm.0 Request processed in 766us (851us total) trans 4294967344 rc 0/0 00000100:00100000:1.0:1787096598.385574:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 272 00000100:00100000:2.0F:1787096598.386962:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1787096598.387007:0:6492:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345528704 00000100:00100000:3.0:1787096598.387018:0:6492:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345528704 00000100:00100000:3.0:1787096598.387053:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 55 00000100:00100000:3.0:1787096598.387062:0:6492:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961848ff1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70e19547-606a-4706-b016-3476e377d7df+20:37797:x1873906345528704:12345-192.168.201.40@tcp:35:rm.0 00000100:00100000:3.0:1787096598.387205:0:6492:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961848ff1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70e19547-606a-4706-b016-3476e377d7df+21:37797:x1873906345528704:12345-192.168.201.40@tcp:35:rm.0 Request processed in 144us (246us total) trans 4294967397 rc 0/0 00000100:00100000:3.0:1787096598.387210:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 55 00000100:00100000:3.0:1787096598.388040:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1787096598.388091:0:9989:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345528960 00000100:00100000:1.0:1787096598.388097:0:9989:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345528960 00000100:00100000:1.0:1787096598.388134:0:9989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 273 00000100:00100000:1.0:1787096598.388152:0:9989:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961743417800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:70e19547-606a-4706-b016-3476e377d7df+21:37797:x1873906345528960:12345-192.168.201.40@tcp:36:rm.0 00010000:00010000:1.0:1787096598.388183:0:9989:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1787096598.388201:0:9989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5800/0xa979d75fc166c6e7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x17:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2247 expref: 21 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.388219:0:9989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5400/0xa979d75fc166c6bd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x17:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2232 expref: 20 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.388233:0:9989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4000/0xa979d75fc166c64d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x17:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2208 expref: 19 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.388244:0:9989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x17:0x0].0x0 (ffff961741933600) 00010000:00010000:1.0:1787096598.388254:0:9989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4800/0xa979d75fc166c631 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2201 expref: 18 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.388262:0:9989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9618472ca600) 00010000:00010000:1.0:1787096598.388265:0:9989:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787096598.388279:0:9989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5600/0xa979d75fc166c72d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.388290:0:9989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5600/0xa979d75fc166c72d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.388311:0:9989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5600/0xa979d75fc166c72d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.388332:0:9989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96185b1d6800/0xa979d75fc166c734 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xebbc3de1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.388339:0:9989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96185b1d6800/0xa979d75fc166c734 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xebbc3de1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.388346:0:9989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96185b1d6800/0xa979d75fc166c734 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xebbc3de1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.388398:0:9989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96185b1d6600/0xa979d75fc166c73b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.388406:0:9989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96185b1d6600/0xa979d75fc166c73b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.388413:0:9989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96185b1d6600/0xa979d75fc166c73b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.388427:0:9989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96185b1d6400/0xa979d75fc166c742 lrc: 3/0,1 mode: --/EX res: [0x200000400:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.388436:0:9989:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4600/0xa979d75fc166c65b lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b220f expref: 17 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.388469:0:9989:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96185b1d6400/0xa979d75fc166c742 lrc: 4/0,1 mode: --/EX res: [0x200000400:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.388498:0:9989:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4600/0xa979d75fc166c65b lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b220f expref: 17 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.388511:0:9989:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4600/0xa979d75fc166c65b lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b220f expref: 17 pid: 9989 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096598.388533:0:9989:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96187c9e6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9989:1873906353998592:192.168.201.40@tcp:104: 00000100:00100000:1.0:1787096598.388610:0:9989:0:(client.c:2692:ptlrpc_set_wait()) set ffff961846d0c900 going to sleep for 11 seconds 00000100:00100000:3.0:1787096598.389304:0:9989:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96187c9e6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9989:1873906353998592:192.168.201.40@tcp:104: 00010000:00010000:3.0:1787096598.389318:0:9989:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96185b1d6400/0xa979d75fc166c742 lrc: 3/0,1 mode: --/EX res: [0x200000400:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096598.389673:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1787096598.389709:0:8380:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345529088 00000100:00100000:1.0:1787096598.389714:0:8380:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345529088 00010000:00010000:1.0:1787096598.389738:0:8380:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4600/0xa979d75fc166c65b lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b220f expref: 18 pid: 9989 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096598.389764:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 87 00000100:00100000:1.0:1787096598.389772:0:8380:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961743417b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:70e19547-606a-4706-b016-3476e377d7df+18:2400:x1873906345529088:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787096598.389780:0:8380:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787096598.389785:0:8380:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4600/0xa979d75fc166c65b lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b220f expref: 18 pid: 9989 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.389794:0:8380:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4600/0xa979d75fc166c65b lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b220f expref: 18 pid: 9989 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.389807:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4600/0xa979d75fc166c65b lrc: 0/0,0 mode: --/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b220f expref: 18 pid: 9989 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.389818:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x6:0x0].0x0 (ffff961741933c00) 00010000:00010000:1.0:1787096598.389822:0:8380:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96185b1d6400/0xa979d75fc166c742 lrc: 3/0,1 mode: --/EX res: [0x200000400:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.389828:0:8380:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96185b1d6400/0xa979d75fc166c742 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.389844:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96185b1d6400/0xa979d75fc166c742 lrc: 4/0,1 mode: EX/EX res: [0x200000400:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096598.389865:0:8380:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787096598.389872:0:9989:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96185b1d6400/0xa979d75fc166c742 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096598.389879:0:9989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96185b1d6400/0xa979d75fc166c742 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096598.389894:0:8380:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961743417b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:70e19547-606a-4706-b016-3476e377d7df+17:2400:x1873906345529088:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 123us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096598.389901:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 87 00010000:00010000:3.0:1787096598.389907:0:9989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff961840030800/0xa979d75fc166c749 lrc: 3/0,1 mode: --/EX res: [0x240000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096598.389913:0:9989:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff961840030800/0xa979d75fc166c749 lrc: 3/0,1 mode: --/EX res: [0x240000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096598.389919:0:9989:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff961840030800/0xa979d75fc166c749 lrc: 3/0,1 mode: --/EX res: [0x240000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096598.389932:0:9989:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961848f69f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:9989:1873906353998720:0@lo:101:mdt00_004.0 00000100:00100000:3.0:1787096598.389968:0:9989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096598.390002:0:6493:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353998720 00000100:00100000:2.0:1787096598.390007:0:6493:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353998720 00000100:00100000:3.0:1787096598.390022:0:9989:0:(client.c:2692:ptlrpc_set_wait()) set ffff96186dd07e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787096598.390042:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1787096598.390050:0:6493:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961848f69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:9989:x1873906353998720:12345-0@lo:101:mdt00_004.0 00010000:00010000:2.0:1787096598.390071:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096598.390086:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4a800/0xa979d75fc166c750 lrc: 2/0,0 mode: --/EX res: [0x240000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa979d75fc166c749 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096598.390103:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4a800/0xa979d75fc166c750 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xa979d75fc166c749 expref: 6 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096598.390114:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4a800/0xa979d75fc166c750 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xa979d75fc166c749 expref: 6 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096598.390121:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x6:0x0].0x0 (ffff961742a27e00) 00010000:00010000:2.0:1787096598.390124:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787096598.390127:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961845b4a800, rc 0) 00000100:00100000:2.0:1787096598.390164:0:6493:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961848f69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:9989:x1873906353998720:12345-0@lo:101:mdt00_004.0 Request processed in 115us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096598.390170:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1787096598.390184:0:9989:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961848f69f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:9989:1873906353998720:0@lo:101:mdt00_004.0 00010000:00010000:3.0:1787096598.390197:0:9989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff961840030800/0xa979d75fc166c749 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xa979d75fc166c750 expref: -99 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096598.390207:0:9989:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff961840030800/0xa979d75fc166c749 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa979d75fc166c750 expref: -99 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096598.390862:0:9989:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961848f69f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:9989:1873906353998848:0@lo:403:mdt00_004.0 00000100:00100000:3.0:1787096598.390893:0:9989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096598.390908:0:9989:0:(client.c:2692:ptlrpc_set_wait()) set ffff96186dd07e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787096598.390934:0:7418:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353998848 00000100:00100000:2.0:1787096598.390939:0:7418:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353998848 00000100:00100000:2.0:1787096598.390974:0:7418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1787096598.390983:0:7418:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961848f6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:9989:x1873906353998848:12345-0@lo:403:mdt00_004.0 00000100:00100000:2.0:1787096598.392567:0:7418:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961848f6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:9989:x1873906353998848:12345-0@lo:403:mdt00_004.0 Request processed in 1583us (1670us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096598.392577:0:7418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1787096598.392591:0:9989:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961848f69f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:9989:1873906353998848:0@lo:403:mdt00_004.0 00000040:00080000:3.0:1787096598.393382:0:9989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].6, 936 off42032 00000040:00080000:3.0:1787096598.393570:0:9989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].6, 1016 off42872 00000004:00080000:3.0:1787096598.393576:0:9989:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff96186dd07e40 with version 12 00000004:00080000:1.0:1787096598.393623:0:8450:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff96187798db40 version 12 rpc_version 12 00000020:00100000:1.0:1787096598.393652:0:8450:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787096598.393660:0:8450:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff96187c9e5880 x1873906353999104/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 2232/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787096598.393679:0:8450:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96187c9e5880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8450:1873906353999104:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787096598.393717:0:8450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096598.393742:0:6494:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353999104 00000100:00100000:1.0:1787096598.393743:0:8450:0:(client.c:2692:ptlrpc_set_wait()) set ffff961846d0cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787096598.393747:0:6494:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353999104 00000100:00100000:3.0:1787096598.393782:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1787096598.393790:0:6494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96187c9e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8450:x1873906353999104:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787096598.393964:0:6494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96187c9e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:8450:x1873906353999104:12345-0@lo:1000:osp_up1-0.0 Request processed in 176us (248us total) trans 4294967345 rc 0/0 00000100:00100000:3.0:1787096598.393971:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1787096598.394004:0:8450:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96187c9e5880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8450:1873906353999104:0@lo:1000:osp_up1-0.0 00000004:00200000:3.0:1787096598.394017:0:9989:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x17:0x0]: returning size 4096 00010000:00010000:3.0:1787096598.394032:0:9989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96185b1d6400/0xa979d75fc166c742 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096598.394038:0:9989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96185b1d6400/0xa979d75fc166c742 lrc: 2/0,0 mode: EX/EX res: [0x200000400:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096598.394050:0:9989:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96185b1d6400/0xa979d75fc166c742 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096598.394054:0:9989:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96185b1d6400 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:3.0:1787096598.394057:0:9989:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96185b1d6400/0xa979d75fc166c742 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096598.394065:0:9989:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96185b1d6400/0xa979d75fc166c742 lrc: 4/0,0 mode: EX/EX res: [0x200000400:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096598.394077:0:9989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x6:0x0].0x0 (ffff961741933c00) 00010000:00010000:3.0:1787096598.394080:0:9989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787096598.394084:0:9989:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96185b1d6400/0xa979d75fc166c742 lrc: 2/0,0 mode: --/EX res: [0x200000400:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096598.394090:0:9989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96185b1d6400/0xa979d75fc166c742 lrc: 0/0,0 mode: --/EX res: [0x200000400:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096598.394102:0:9989:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff961840030800/0xa979d75fc166c749 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa979d75fc166c750 expref: -99 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096598.394110:0:9989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff961840030800/0xa979d75fc166c749 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xa979d75fc166c750 expref: -99 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096598.394117:0:9989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff961840030800/0xa979d75fc166c749 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xa979d75fc166c750 expref: -99 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096598.394137:0:9989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1787096598.394144:0:9989:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x6:0x0] 00010000:00010000:3.0:1787096598.394151:0:9989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96185b1d6600/0xa979d75fc166c73b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096598.394160:0:6477:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787096598.394163:0:9989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96185b1d6600/0xa979d75fc166c73b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096598.394173:0:9989:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96185b1d6600/0xa979d75fc166c73b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096598.394175:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff961840030800/0xa979d75fc166c749 lrc: 2/0,0 mode: EX/EX res: [0x240000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xa979d75fc166c750 expref: -99 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096598.394188:0:9989:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96185b1d6600 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:2.0:1787096598.394189:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961840030800 already unused, calling callback (ffffffffc1765ee0) 00010000:00010000:3.0:1787096598.394192:0:9989:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96185b1d6600/0xa979d75fc166c73b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096598.394194:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff961840030800/0xa979d75fc166c749 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xa979d75fc166c750 expref: -99 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096598.394208:0:9989:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96185b1d6600/0xa979d75fc166c73b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787096598.394209:0:6477:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff961840030800/0xa979d75fc166c749 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xa979d75fc166c750 expref: -99 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096598.394227:0:9989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x17:0x0].0x0 (ffff961741933600) 00010000:00010000:3.0:1787096598.394231:0:9989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787096598.394234:0:9989:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96185b1d6600/0xa979d75fc166c73b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096598.394238:0:6477:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff961840030800/0xa979d75fc166c749 lrc: 2/0,0 mode: --/EX res: [0x240000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xa979d75fc166c750 expref: -99 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096598.394240:0:9989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96185b1d6600/0xa979d75fc166c73b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096598.394249:0:6477:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787096598.394265:0:9989:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5600/0xa979d75fc166c72d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096598.394271:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff961840030800/0xa979d75fc166c749 lrc: 1/0,0 mode: --/EX res: [0x240000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xa979d75fc166c750 expref: -99 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096598.394274:0:9989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5600/0xa979d75fc166c72d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096598.394279:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff961840030800/0xa979d75fc166c749 lrc: 0/0,0 mode: --/EX res: [0x240000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xa979d75fc166c750 expref: -99 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096598.394286:0:9989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5600/0xa979d75fc166c72d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096598.394291:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961848ff2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1873906353999232:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787096598.394292:0:9989:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5600/0xa979d75fc166c72d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096598.394297:0:6477:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787096598.394300:0:6477:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787096598.394302:0:6477:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787096598.394304:0:9989:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96186ddf5600 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:3.0:1787096598.394308:0:9989:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5600/0xa979d75fc166c72d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096598.394312:0:9989:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5600/0xa979d75fc166c72d lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096598.394320:0:9989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9618472ca600) 00010000:00010000:3.0:1787096598.394323:0:9989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787096598.394326:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787096598.394327:0:9989:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5600/0xa979d75fc166c72d lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096598.394332:0:9989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5600/0xa979d75fc166c72d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787096598.394341:0:9989:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000002c28969d reply state 000000004012a427 transno 4294967398 ns: mdt-lustre-MDT0000_UUID lock: ffff96185b1d6800/0xa979d75fc166c734 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xebbc3de1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096598.394349:0:9989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96185b1d6800/0xa979d75fc166c734 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xebbc3de1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096598.394355:0:9989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xebbc3de1 (ffff961741933b00) 00010000:00010000:3.0:1787096598.394357:0:9989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787096598.394359:0:9989:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787096598.394364:0:6474:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353999232 00000100:00100000:2.0:1787096598.394370:0:6474:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353999232 00000100:00100000:3.0:1787096598.394400:0:9989:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961743417800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:70e19547-606a-4706-b016-3476e377d7df+18:37797:x1873906345528960:12345-192.168.201.40@tcp:36:rm.0 Request processed in 6259us (6359us total) trans 4294967398 rc 0/0 00000100:00100000:3.0:1787096598.394406:0:9989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 273 00000100:00100000:2.0:1787096598.394411:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787096598.394421:0:6474:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96187c9e7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+7:3637:x1873906353999232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787096598.394432:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787096598.394467:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4a800/0xa979d75fc166c750 lrc: 0/0,0 mode: --/EX res: [0x240000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xa979d75fc166c749 expref: 7 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096598.394487:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x6:0x0].0x0 (ffff961742a27e00) 00010000:00010000:2.0:1787096598.394497:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787096598.394541:0:6474:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96187c9e7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+6:3637:x1873906353999232:12345-0@lo:103:ldlm_bl.0 Request processed in 122us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096598.394547:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787096598.394557:0:3637:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961848ff2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1873906353999232:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787096598.798559:0:6476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787096598.956221:0:23502:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 26b: EC data integrity with patterned data and 4M stripes ========================================================== 19:43:18 (1787096598) 00000100:00100000:3.0:1787096599.016826:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1787096599.016858:0:6489:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345529216 00000100:00100000:1.0:1787096599.016867:0:6489:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345529216 00000100:00100000:1.0:1787096599.016910:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 274 00000100:00100000:1.0:1787096599.016917:0:6489:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961848f69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70e19547-606a-4706-b016-3476e377d7df+18:37966:x1873906345529216:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1787096599.016942:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096599.016957:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4c00/0xa979d75fc166c757 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2ded7f867b2255 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.017007:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4200/0xa979d75fc166c75e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.017028:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4200/0xa979d75fc166c75e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.017037:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4200/0xa979d75fc166c75e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787096599.017079:0:6489:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787096599.017084:0:6489:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787096599.017106:0:6489:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4200/0xa979d75fc166c75e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.017130:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4c00/0xa979d75fc166c757 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2255 expref: 20 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.017145:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4200/0xa979d75fc166c75e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2255 expref: 19 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.017154:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9618472ca600) 00010000:00010000:1.0:1787096599.017157:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787096599.017161:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96186ddf4200, rc 0) 00000100:00100000:1.0:1787096599.017208:0:6489:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961848f69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70e19547-606a-4706-b016-3476e377d7df+19:37966:x1873906345529216:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 291us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096599.017214:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 274 00000100:00100000:1.0:1787096599.018004:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1787096599.018041:0:6488:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345529344 00000100:00100000:0.0:1787096599.018045:0:6488:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345529344 00000100:00100000:0.0:1787096599.018088:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 275 00000100:00100000:0.0:1787096599.018099:0:6488:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96187c9e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70e19547-606a-4706-b016-3476e377d7df+19:37966:x1873906345529344:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1787096599.018109:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787096599.018121:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96174340fa00/0xa979d75fc166c765 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2ded7f867b225c expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096599.018155:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f000/0xa979d75fc166c76c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096599.018163:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f000/0xa979d75fc166c76c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096599.018169:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f000/0xa979d75fc166c76c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096599.018230:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e000/0xa979d75fc166c773 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x67f1858 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096599.018235:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e000/0xa979d75fc166c773 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096599.018247:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e000/0xa979d75fc166c773 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096599.018276:0:6488:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f000/0xa979d75fc166c76c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096599.018282:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f000/0xa979d75fc166c76c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096599.018286:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f000/0xa979d75fc166c76c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096599.018290:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f000/0xa979d75fc166c76c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096599.018294:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96174340f000 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:0.0:1787096599.018296:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f000/0xa979d75fc166c76c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096599.018301:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f000/0xa979d75fc166c76c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096599.018308:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9618472ca600) 00010000:00010000:0.0:1787096599.018310:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096599.018312:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f000/0xa979d75fc166c76c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096599.018316:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f000/0xa979d75fc166c76c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096599.018324:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e000/0xa979d75fc166c773 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096599.018336:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e000/0xa979d75fc166c773 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096599.018342:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e000/0xa979d75fc166c773 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096599.018347:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96174340e000 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:0.0:1787096599.018351:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e000/0xa979d75fc166c773 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096599.018357:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e000/0xa979d75fc166c773 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096599.018366:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x67f1858 (ffff961741936400) 00010000:00010000:0.0:1787096599.018368:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096599.018371:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e000/0xa979d75fc166c773 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096599.018377:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e000/0xa979d75fc166c773 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096599.018405:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96174340fa00/0xa979d75fc166c765 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b225c expref: 20 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096599.018416:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9618472ca600) 00010000:00010000:0.0:1787096599.018419:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096599.018424:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96174340fa00/0xa979d75fc166c765 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b225c expref: 20 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096599.018435:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96174340fa00, rc 0) 00000100:00100000:0.0:1787096599.018510:0:6488:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96187c9e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70e19547-606a-4706-b016-3476e377d7df+19:37966:x1873906345529344:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 413us (504us total) trans 0 rc 301/301 00000100:00100000:0.0:1787096599.018518:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 275 00000100:00100000:0.0:1787096599.019873:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1787096599.019914:0:9989:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345529600 00000100:00100000:3.0:1787096599.019921:0:9989:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345529600 00000100:00100000:3.0:1787096599.019958:0:9989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 276 00000100:00100000:3.0:1787096599.019969:0:9989:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742ff3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:70e19547-606a-4706-b016-3476e377d7df+19:37966:x1873906345529600:12345-192.168.201.40@tcp:36:lfs.0 00010000:00010000:3.0:1787096599.020005:0:9989:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787096599.020019:0:9989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4200/0xa979d75fc166c75e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2255 expref: 19 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096599.020036:0:9989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9618472ca600) 00010000:00010000:3.0:1787096599.020040:0:9989:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787096599.020075:0:9989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff961840030800/0xa979d75fc166c77a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096599.020087:0:9989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961840030800/0xa979d75fc166c77a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096599.020096:0:9989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961840030800/0xa979d75fc166c77a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096599.020112:0:9989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961840030400/0xa979d75fc166c781 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x67f1858 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096599.020119:0:9989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961840030400/0xa979d75fc166c781 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096599.020125:0:9989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961840030400/0xa979d75fc166c781 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787096599.020841:0:9989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].7, 2152 off44184 00000040:00080000:3.0:1787096599.020921:0:9989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].7, 2352 off45224 00000004:00080000:3.0:1787096599.020930:0:9989:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff961742a35e40 with version 13 00000004:00080000:2.0:1787096599.020962:0:8450:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff96187798db40 version 13 rpc_version 13 00000020:00100000:2.0:1787096599.020991:0:8450:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787096599.020998:0:8450:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff961848ff0e00 x1873906353999488/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 4216/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787096599.021019:0:8450:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961848ff0e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8450:1873906353999488:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787096599.021086:0:8450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096599.021123:0:23023:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353999488 00000100:00100000:0.0:1787096599.021128:0:23023:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353999488 00000100:00100000:2.0:1787096599.021139:0:8450:0:(client.c:2692:ptlrpc_set_wait()) set ffff961742d74600 going to sleep for 11 seconds 00000100:00100000:0.0:1787096599.021175:0:23023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1787096599.021186:0:23023:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961848ff3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:8450:x1873906353999488:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787096599.021562:0:23023:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961848ff3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+7:8450:x1873906353999488:12345-0@lo:1000:osp_up1-0.0 Request processed in 378us (475us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1787096599.021572:0:23023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1787096599.021631:0:8450:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961848ff0e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8450:1873906353999488:0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1787096599.021706:0:9989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961840030e00/0xa979d75fc166c788 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096599.021714:0:9989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961840030e00/0xa979d75fc166c788 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096599.021720:0:9989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961840030e00/0xa979d75fc166c788 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096599.021732:0:9989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961840030000/0xa979d75fc166c78f lrc: 3/0,1 mode: --/PW res: [0x200000400:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096599.021737:0:9989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961840030000/0xa979d75fc166c78f lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096599.021742:0:9989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961840030000/0xa979d75fc166c78f lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096599.021766:0:9989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff961840030c00/0xa979d75fc166c796 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096599.021771:0:9989:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff961840030c00/0xa979d75fc166c796 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096599.021779:0:9989:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff961840030c00/0xa979d75fc166c796 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096599.021791:0:9989:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961848f68000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:9989:1873906353999616:0@lo:101:mdt00_004.0 00000100:00100000:3.0:1787096599.021813:0:9989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096599.021838:0:9989:0:(client.c:2692:ptlrpc_set_wait()) set ffff961850218480 going to sleep for 11 seconds 00000100:00100000:1.0:1787096599.021838:0:6493:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353999616 00000100:00100000:1.0:1787096599.021844:0:6493:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353999616 00000100:00100000:1.0:1787096599.021874:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1787096599.021881:0:6493:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961848f69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:9989:x1873906353999616:12345-0@lo:101:mdt00_004.0 00010000:00010000:1.0:1787096599.021899:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096599.021912:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4a00/0xa979d75fc166c79d lrc: 2/0,0 mode: --/PW res: [0x240000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa979d75fc166c796 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.021930:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4a00/0xa979d75fc166c79d lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xa979d75fc166c796 expref: 8 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.021958:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4a00/0xa979d75fc166c79d lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xa979d75fc166c796 expref: 8 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.021967:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x7:0x0].0x0 (ffff961848fbf000) 00010000:00010000:1.0:1787096599.021969:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096599.021972:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96186ddf4a00, rc 0) 00000100:00100000:1.0:1787096599.022005:0:6493:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961848f69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:9989:x1873906353999616:12345-0@lo:101:mdt00_004.0 Request processed in 125us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096599.022011:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1787096599.022046:0:9989:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961848f68000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:9989:1873906353999616:0@lo:101:mdt00_004.0 00010000:00010000:3.0:1787096599.022075:0:9989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff961840030c00/0xa979d75fc166c796 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xa979d75fc166c79d expref: -99 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096599.022087:0:9989:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff961840030c00/0xa979d75fc166c796 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa979d75fc166c79d expref: -99 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787096599.022106:0:9989:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000003ab2a5c2 reply state 000000005211399c transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff961840030000/0xa979d75fc166c78f lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096599.022117:0:9989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961840030000/0xa979d75fc166c78f lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096599.022124:0:9989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x7:0x0].0x0 (ffff961843e27b00) 00010000:00010000:3.0:1787096599.022127:0:9989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787096599.022130:0:9989:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787096599.022135:0:9989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff961840030c00/0xa979d75fc166c796 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xa979d75fc166c79d expref: -99 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096599.022143:0:9989:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff961840030c00/0xa979d75fc166c796 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xa979d75fc166c79d expref: -99 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787096599.022151:0:9989:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x7:0x0] 00000004:00010000:3.0:1787096599.022156:0:9989:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000003ab2a5c2 reply state 000000005211399c transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff961840030e00/0xa979d75fc166c788 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096599.022163:0:9989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961840030e00/0xa979d75fc166c788 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096599.022169:0:9989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff961843e27600) 00010000:00010000:3.0:1787096599.022171:0:9989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787096599.022178:0:9989:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:3.0:1787096599.022183:0:9989:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x18:0x0]: returning size 4096 00010000:00010000:3.0:1787096599.022189:0:9989:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff961840030800/0xa979d75fc166c77a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096599.022195:0:9989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff961840030800/0xa979d75fc166c77a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096599.022201:0:9989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961840030800/0xa979d75fc166c77a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096599.022207:0:9989:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961840030800/0xa979d75fc166c77a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096599.022212:0:9989:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961840030800 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:3.0:1787096599.022224:0:9989:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961840030800/0xa979d75fc166c77a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096599.022232:0:9989:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961840030800/0xa979d75fc166c77a lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096599.022243:0:9989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9618472ca600) 00010000:00010000:3.0:1787096599.022245:0:9989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096599.022248:0:9989:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961840030800/0xa979d75fc166c77a lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096599.022254:0:9989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961840030800/0xa979d75fc166c77a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787096599.022269:0:9989:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000003ab2a5c2 reply state 000000005211399c transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff961840030400/0xa979d75fc166c781 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096599.022278:0:9989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961840030400/0xa979d75fc166c781 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096599.022292:0:9989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x67f1858 (ffff961843e27400) 00010000:00010000:3.0:1787096599.022295:0:9989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787096599.022297:0:9989:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:3.0:1787096599.022365:0:9989:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742ff3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:70e19547-606a-4706-b016-3476e377d7df+20:37966:x1873906345529600:12345-192.168.201.40@tcp:36:lfs.0 Request processed in 2397us (2489us total) trans 4294967399 rc 0/0 00000100:00100000:3.0:1787096599.022373:0:9989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 276 00010000:00010000:1.0:1787096599.022384:0:6467:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff961840030c00/0xa979d75fc166c796 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xa979d75fc166c79d expref: -99 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787096599.022395:0:6467:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff961840030c00/0xa979d75fc166c796 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xa979d75fc166c79d expref: -99 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096599.022417:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f600/0xa979d75fc166c4fd lrc: 3/0,1 mode: TXN/TXN res: [0x200000401:0x7:0x0].0x98f97dfb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.022420:0:6467:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff961840030c00/0xa979d75fc166c796 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xa979d75fc166c79d expref: -99 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096599.022433:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f600/0xa979d75fc166c4fd lrc: 2/0,0 mode: TXN/TXN res: [0x200000401:0x7:0x0].0x98f97dfb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.022435:0:6467:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787096599.022475:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f600/0xa979d75fc166c4fd lrc: 3/0,0 mode: TXN/TXN res: [0x200000401:0x7:0x0].0x98f97dfb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096599.022481:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96174340f600 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:2.0:1787096599.022485:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f600/0xa979d75fc166c4fd lrc: 3/0,0 mode: TXN/TXN res: [0x200000401:0x7:0x0].0x98f97dfb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.022488:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff961840030c00/0xa979d75fc166c796 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xa979d75fc166c79d expref: -99 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096599.022494:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f600/0xa979d75fc166c4fd lrc: 4/0,0 mode: TXN/TXN res: [0x200000401:0x7:0x0].0x98f97dfb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096599.022499:0:3634:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96187c9e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1873906353999744:0@lo:103:jbd2/dm-0-8.0 00000001:00080000:1.0:1787096599.022517:0:6467:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00010000:00010000:2.0:1787096599.022528:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x98f97dfb (ffff961741933200) 00010000:00010000:2.0:1787096599.022531:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096599.022534:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f600/0xa979d75fc166c4fd lrc: 2/0,0 mode: --/TXN res: [0x200000401:0x7:0x0].0x98f97dfb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096599.022539:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f600/0xa979d75fc166c4fd lrc: 0/0,0 mode: --/TXN res: [0x200000401:0x7:0x0].0x98f97dfb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787096599.022539:0:6467:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000100:00100000:3.0:1787096599.022551:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787096599.022554:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5a00/0xa979d75fc166c582 lrc: 3/0,1 mode: TXN/TXN res: [0x200000401:0x7:0x0].0x98f97dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096599.022558:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5a00/0xa979d75fc166c582 lrc: 2/0,0 mode: TXN/TXN res: [0x200000401:0x7:0x0].0x98f97dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787096599.022561:0:6467:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967393 is committed 00010000:00010000:2.0:1787096599.022562:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5a00/0xa979d75fc166c582 lrc: 3/0,0 mode: TXN/TXN res: [0x200000401:0x7:0x0].0x98f97dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096599.022568:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96186ddf5a00 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:2.0:1787096599.022571:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5a00/0xa979d75fc166c582 lrc: 3/0,0 mode: TXN/TXN res: [0x200000401:0x7:0x0].0x98f97dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787096599.022572:0:6467:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff961742971c00 refcount 2 committed 0 result 0 batchid 5 00010000:00010000:2.0:1787096599.022579:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5a00/0xa979d75fc166c582 lrc: 4/0,0 mode: TXN/TXN res: [0x200000401:0x7:0x0].0x98f97dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787096599.022579:0:6467:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff961742cfd700 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff961742971600 00010000:00010000:2.0:1787096599.022595:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x98f97dfb (ffff961741933200) 00010000:00010000:2.0:1787096599.022597:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000020:00080000:1.0:1787096599.022597:0:6467:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].5 00010000:00010000:2.0:1787096599.022601:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5a00/0xa979d75fc166c582 lrc: 2/0,0 mode: --/TXN res: [0x200000401:0x7:0x0].0x98f97dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787096599.022602:0:6467:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff961742cfd500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff961742f7be00 00000020:00080000:1.0:1787096599.022610:0:6467:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].5 00010000:00010000:2.0:1787096599.022611:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5a00/0xa979d75fc166c582 lrc: 0/0,0 mode: --/TXN res: [0x200000401:0x7:0x0].0x98f97dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787096599.022621:0:6520:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00010000:00010000:2.0:1787096599.022634:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e400/0xa979d75fc166c607 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xebbc3de1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096599.022639:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e400/0xa979d75fc166c607 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xebbc3de1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096599.022643:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e400/0xa979d75fc166c607 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xebbc3de1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096599.022648:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96174340e400 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:2.0:1787096599.022651:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e400/0xa979d75fc166c607 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xebbc3de1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096599.022657:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e400/0xa979d75fc166c607 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xebbc3de1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096599.022667:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xebbc3de1 (ffff961741933b00) 00010000:00010000:2.0:1787096599.022670:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787096599.022671:0:7412:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353999744 00010000:00010000:2.0:1787096599.022673:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e400/0xa979d75fc166c607 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xebbc3de1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096599.022676:0:7412:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353999744 00010000:00010000:2.0:1787096599.022684:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e400/0xa979d75fc166c607 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xebbc3de1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787096599.022691:0:6520:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff961842ba76c0 with version 14 00010000:00010000:2.0:1787096599.022697:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f400/0xa979d75fc166c60e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096599.022703:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f400/0xa979d75fc166c60e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787096599.022705:0:6520:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 4 cancel update log [0x240000401:0x3:0x0].4: rc = 0 00010000:00010000:2.0:1787096599.022709:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f400/0xa979d75fc166c60e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787096599.022715:0:8450:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff96187798db40 version 14 rpc_version 14 00000100:00100000:3.0:1787096599.022718:0:7412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00010000:00010000:2.0:1787096599.022726:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96174340f400 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:2.0:1787096599.022728:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f400/0xa979d75fc166c60e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096599.022734:0:7412:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9618589c8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+8:3634:x1873906353999744:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:2.0:1787096599.022735:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f400/0xa979d75fc166c60e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787096599.022736:0:8450:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000020:00080000:0.0:1787096599.022741:0:6520:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 4 cancel update log [0x200000400:0x3:0x0].4: rc = 0 00000100:00100000:1.0:1787096599.022748:0:8450:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff96187c9e7480 x1873906354000000/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:3.0:1787096599.022751:0:7412:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787096599.022755:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x17:0x0].0x0 (ffff961741933600) 00000020:00080000:0.0:1787096599.022755:0:6520:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:2.0:1787096599.022761:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096599.022767:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f400/0xa979d75fc166c60e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096599.022769:0:7412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4a00/0xa979d75fc166c79d lrc: 0/0,0 mode: --/PW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xa979d75fc166c796 expref: 8 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096599.022776:0:8450:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96187c9e7480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8450:1873906354000000:0@lo:1000:osp_up1-0.0 00010000:00010000:2.0:1787096599.022782:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f400/0xa979d75fc166c60e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096599.022799:0:7412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x7:0x0].0x0 (ffff961848fbf000) 00010000:00010000:2.0:1787096599.022807:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96174340fc00/0xa979d75fc166c615 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096599.022811:0:7412:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787096599.022818:0:8450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787096599.022819:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96174340fc00/0xa979d75fc166c615 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096599.022824:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96174340fc00/0xa979d75fc166c615 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096599.022828:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96174340fc00 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:2.0:1787096599.022830:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96174340fc00/0xa979d75fc166c615 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096599.022834:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96174340fc00/0xa979d75fc166c615 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096599.022848:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x6:0x0].0x0 (ffff961741933c00) 00010000:00010000:2.0:1787096599.022850:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787096599.022850:0:8450:0:(client.c:2692:ptlrpc_set_wait()) set ffff961846d0c480 going to sleep for 11 seconds 00000100:00100000:0.0:1787096599.022852:0:7418:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906354000000 00010000:00010000:2.0:1787096599.022854:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96174340fc00/0xa979d75fc166c615 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096599.022857:0:7418:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906354000000 00010000:00010000:2.0:1787096599.022859:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96174340fc00/0xa979d75fc166c615 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096599.022863:0:7412:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9618589c8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+7:3634:x1873906353999744:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 132us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096599.022874:0:7412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:2.0:1787096599.022878:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96185b1d6800/0xa979d75fc166c734 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xebbc3de1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096599.022882:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96185b1d6800/0xa979d75fc166c734 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xebbc3de1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096599.022886:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96185b1d6800/0xa979d75fc166c734 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xebbc3de1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096599.022890:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96185b1d6800 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:2.0:1787096599.022893:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96185b1d6800/0xa979d75fc166c734 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xebbc3de1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096599.022897:0:7418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00010000:00010000:2.0:1787096599.022903:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96185b1d6800/0xa979d75fc166c734 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xebbc3de1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096599.022909:0:7418:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96187c9e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:8450:x1873906354000000:12345-0@lo:1000:osp_up1-0.0 00010000:00010000:2.0:1787096599.022910:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xebbc3de1 (ffff961741933b00) 00010000:00010000:2.0:1787096599.022916:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096599.022918:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96185b1d6800/0xa979d75fc166c734 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xebbc3de1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096599.022921:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96185b1d6800/0xa979d75fc166c734 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xebbc3de1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096599.022939:0:3634:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96187c9e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1873906353999744:0@lo:103:jbd2/dm-0-8.0 00010000:00010000:2.0:1787096599.022942:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff961840030400/0xa979d75fc166c781 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096599.022949:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961840030400/0xa979d75fc166c781 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096599.022955:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961840030400/0xa979d75fc166c781 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096599.022960:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961840030400 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:2.0:1787096599.022963:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961840030400/0xa979d75fc166c781 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096599.022970:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961840030400/0xa979d75fc166c781 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096599.022979:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x67f1858 (ffff961843e27400) 00010000:00010000:2.0:1787096599.022982:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096599.022985:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961840030400/0xa979d75fc166c781 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096599.022992:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961840030400/0xa979d75fc166c781 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096599.022997:0:7418:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96187c9e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:8450:x1873906354000000:12345-0@lo:1000:osp_up1-0.0 Request processed in 89us (181us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1787096599.023006:0:7418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00010000:00010000:2.0:1787096599.023008:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff961840030e00/0xa979d75fc166c788 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096599.023016:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961840030e00/0xa979d75fc166c788 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096599.023021:0:8450:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96187c9e7480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8450:1873906354000000:0@lo:1000:osp_up1-0.0 00010000:00010000:2.0:1787096599.023026:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961840030e00/0xa979d75fc166c788 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096599.023052:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961840030e00 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:2.0:1787096599.023055:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961840030e00/0xa979d75fc166c788 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096599.023067:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961840030e00/0xa979d75fc166c788 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096599.023076:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff961843e27600) 00010000:00010000:2.0:1787096599.023077:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096599.023079:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961840030e00/0xa979d75fc166c788 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096599.023084:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961840030e00/0xa979d75fc166c788 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096599.023096:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff961840030000/0xa979d75fc166c78f lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096599.023102:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961840030000/0xa979d75fc166c78f lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096599.023108:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961840030000/0xa979d75fc166c78f lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096599.023114:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961840030000 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:2.0:1787096599.023116:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961840030000/0xa979d75fc166c78f lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096599.023122:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961840030000/0xa979d75fc166c78f lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096599.023135:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x7:0x0].0x0 (ffff961843e27b00) 00010000:00010000:2.0:1787096599.023137:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096599.023139:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961840030000/0xa979d75fc166c78f lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096599.023142:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961840030000/0xa979d75fc166c78f lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096599.032711:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1787096599.032761:0:6489:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345529728 00000100:00100000:1.0:1787096599.032769:0:6489:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345529728 00000100:00100000:1.0:1787096599.032813:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 277 00000100:00100000:1.0:1787096599.032823:0:6489:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961848f68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70e19547-606a-4706-b016-3476e377d7df+5:37969:x1873906345529728:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1787096599.032847:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096599.032866:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4c00/0xa979d75fc166c7a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2ded7f867b2263 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.032917:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5000/0xa979d75fc166c7ab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.032937:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5000/0xa979d75fc166c7ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.032946:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5000/0xa979d75fc166c7ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787096599.032979:0:6489:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787096599.032982:0:6489:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787096599.032995:0:6489:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5000/0xa979d75fc166c7ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.033012:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4c00/0xa979d75fc166c7a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2263 expref: 7 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.033033:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5000/0xa979d75fc166c7ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2263 expref: 6 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.033042:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9618472ca600) 00010000:00010000:1.0:1787096599.033045:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787096599.033049:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96186ddf5000, rc 0) 00000100:00100000:1.0:1787096599.033103:0:6489:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961848f68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70e19547-606a-4706-b016-3476e377d7df+6:37969:x1873906345529728:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 282us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096599.033110:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 277 00000100:00100000:0.0:1787096599.034188:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1787096599.034235:0:6488:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345529856 00000100:00100000:1.0:1787096599.034241:0:6488:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345529856 00000100:00100000:1.0:1787096599.034273:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 278 00000100:00100000:1.0:1787096599.034281:0:6488:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742ff3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70e19547-606a-4706-b016-3476e377d7df+6:37969:x1873906345529856:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1787096599.034291:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096599.034308:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5200/0xa979d75fc166c7b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2ded7f867b226a expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.034342:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4400/0xa979d75fc166c7b9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.034348:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4400/0xa979d75fc166c7b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.034353:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4400/0xa979d75fc166c7b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.034362:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5a00/0xa979d75fc166c7c0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x67f1858 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.034366:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5a00/0xa979d75fc166c7c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.034370:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5a00/0xa979d75fc166c7c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.034426:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4a00/0xa979d75fc166c7c7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.034434:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4a00/0xa979d75fc166c7c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.034464:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4a00/0xa979d75fc166c7c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787096599.034536:0:6488:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x18:0x0]: returning size 4096 00000004:00200000:1.0:1787096599.034540:0:6488:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:1.0:1787096599.034554:0:6488:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4a00/0xa979d75fc166c7c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.034572:0:6488:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4400/0xa979d75fc166c7b9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.034578:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4400/0xa979d75fc166c7b9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.034598:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4400/0xa979d75fc166c7b9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.034604:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4400/0xa979d75fc166c7b9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.034610:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96186ddf4400 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:1.0:1787096599.034613:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4400/0xa979d75fc166c7b9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.034620:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4400/0xa979d75fc166c7b9 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.034630:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9618472ca600) 00010000:00010000:1.0:1787096599.034632:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096599.034636:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4400/0xa979d75fc166c7b9 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.034642:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4400/0xa979d75fc166c7b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.034651:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5a00/0xa979d75fc166c7c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.034657:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5a00/0xa979d75fc166c7c0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.034668:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5a00/0xa979d75fc166c7c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.034672:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96186ddf5a00 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:1.0:1787096599.034675:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5a00/0xa979d75fc166c7c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.034681:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5a00/0xa979d75fc166c7c0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.034688:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x67f1858 (ffff961848fbfe00) 00010000:00010000:1.0:1787096599.034690:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096599.034693:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5a00/0xa979d75fc166c7c0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.034698:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5a00/0xa979d75fc166c7c0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.034721:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5200/0xa979d75fc166c7b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b226a expref: 8 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.034732:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4a00/0xa979d75fc166c7c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b226a expref: 7 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.034746:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff961848fbfa00) 00010000:00010000:1.0:1787096599.034748:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787096599.034750:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96186ddf4a00, rc 0) 00000100:00100000:1.0:1787096599.034788:0:6488:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742ff3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70e19547-606a-4706-b016-3476e377d7df+7:37969:x1873906345529856:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 509us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096599.034804:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 278 00000100:00100000:0.0:1787096599.035653:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1787096599.035690:0:9989:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345529984 00000100:00100000:3.0:1787096599.035696:0:9989:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345529984 00000100:00100000:3.0:1787096599.035738:0:9989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 279 00000100:00100000:3.0:1787096599.035752:0:9989:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742c99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:70e19547-606a-4706-b016-3476e377d7df+7:37969:x1873906345529984:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1787096599.035762:0:9989:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787096599.035774:0:9989:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961840030800/0xa979d75fc166c7ce lrc: 2/0,0 mode: --/CR res: [0x200000400:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2ded7f867b2271 expref: -99 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096599.035805:0:9989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961840031000/0xa979d75fc166c7d5 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096599.035816:0:9989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961840031000/0xa979d75fc166c7d5 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096599.035825:0:9989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961840031000/0xa979d75fc166c7d5 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787096599.035852:0:9989:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000400:0x7:0x0]: returning size 4096 00000004:00200000:3.0:1787096599.035856:0:9989:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1787096599.035877:0:9989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961840030800/0xa979d75fc166c7ce lrc: 0/0,0 mode: --/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2271 expref: 9 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096599.035891:0:9989:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961840031000/0xa979d75fc166c7d5 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2271 expref: 8 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096599.035900:0:9989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x7:0x0].0x0 (ffff961843e27700) 00010000:00010000:3.0:1787096599.035902:0:9989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787096599.035905:0:9989:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961840031000, rc 0) 00000100:00100000:3.0:1787096599.035941:0:9989:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742c99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:70e19547-606a-4706-b016-3476e377d7df+8:37969:x1873906345529984:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 191us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096599.035948:0:9989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 279 00000100:00100000:3.0:1787096599.036680:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1787096599.036716:0:6489:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345530112 00000100:00100000:1.0:1787096599.036721:0:6489:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345530112 00000100:00100000:1.0:1787096599.036751:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 280 00000100:00100000:1.0:1787096599.036758:0:6489:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961848f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70e19547-606a-4706-b016-3476e377d7df+10:37969:x1873906345530112:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1787096599.036770:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096599.036784:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4200/0xa979d75fc166c7dc lrc: 2/0,0 mode: --/CR res: [0x240000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2ded7f867b2278 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.036814:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf5800/0xa979d75fc166c7e3 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.036823:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf5800/0xa979d75fc166c7e3 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.036830:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf5800/0xa979d75fc166c7e3 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787096599.036854:0:6489:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000401:0x7:0x0]: returning size 4096 00000004:00200000:1.0:1787096599.036857:0:6489:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1787096599.036876:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4200/0xa979d75fc166c7dc lrc: 0/0,0 mode: --/CR res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2278 expref: 12 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.036888:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf5800/0xa979d75fc166c7e3 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2278 expref: 11 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.036894:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x7:0x0].0x0 (ffff961848fbf600) 00010000:00010000:1.0:1787096599.036897:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787096599.036905:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96186ddf5800, rc 0) 00000100:00100000:1.0:1787096599.036933:0:6489:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961848f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70e19547-606a-4706-b016-3476e377d7df+11:37969:x1873906345530112:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 176us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096599.036939:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 280 00000100:00100000:0.0:1787096599.037750:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1787096599.037789:0:6488:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345530240 00000100:00100000:1.0:1787096599.037794:0:6488:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345530240 00000100:00100000:1.0:1787096599.037822:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 281 00000100:00100000:1.0:1787096599.037830:0:6488:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742c99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70e19547-606a-4706-b016-3476e377d7df+11:37969:x1873906345530240:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1787096599.037838:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096599.037845:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf5400/0xa979d75fc166c7ea lrc: 2/0,0 mode: --/CR res: [0x240000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2ded7f867b227f expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.037873:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4000/0xa979d75fc166c7f1 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.037882:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4000/0xa979d75fc166c7f1 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.037889:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4000/0xa979d75fc166c7f1 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.037946:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4800/0xa979d75fc166c7f8 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x7:0x0].0x91dd68a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.037954:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4800/0xa979d75fc166c7f8 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x7:0x0].0x91dd68a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.037960:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4800/0xa979d75fc166c7f8 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x7:0x0].0x91dd68a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.037996:0:6488:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4000/0xa979d75fc166c7f1 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.038008:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4000/0xa979d75fc166c7f1 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.038014:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4000/0xa979d75fc166c7f1 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.038020:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4000/0xa979d75fc166c7f1 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.038026:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96186ddf4000 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:1.0:1787096599.038030:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4000/0xa979d75fc166c7f1 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.038037:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4000/0xa979d75fc166c7f1 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.038046:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x7:0x0].0x0 (ffff961848fbf600) 00010000:00010000:1.0:1787096599.038048:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096599.038051:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4000/0xa979d75fc166c7f1 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.038068:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4000/0xa979d75fc166c7f1 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.038077:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4800/0xa979d75fc166c7f8 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x7:0x0].0x91dd68a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.038083:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4800/0xa979d75fc166c7f8 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x7:0x0].0x91dd68a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.038088:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4800/0xa979d75fc166c7f8 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x7:0x0].0x91dd68a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.038098:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96186ddf4800 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:1.0:1787096599.038100:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4800/0xa979d75fc166c7f8 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x7:0x0].0x91dd68a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.038106:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4800/0xa979d75fc166c7f8 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x7:0x0].0x91dd68a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.038113:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x7:0x0].0x91dd68a8 (ffff961848fbff00) 00010000:00010000:1.0:1787096599.038115:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096599.038118:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4800/0xa979d75fc166c7f8 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x7:0x0].0x91dd68a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.038123:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4800/0xa979d75fc166c7f8 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x7:0x0].0x91dd68a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.038145:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf5400/0xa979d75fc166c7ea lrc: 1/0,0 mode: --/CR res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b227f expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.038154:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x7:0x0].0x0 (ffff961848fbf600) 00010000:00010000:1.0:1787096599.038156:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096599.038159:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf5400/0xa979d75fc166c7ea lrc: 0/0,0 mode: --/CR res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b227f expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.038167:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96186ddf5400, rc 0) 00000100:00100000:1.0:1787096599.038197:0:6488:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742c99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70e19547-606a-4706-b016-3476e377d7df+11:37969:x1873906345530240:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 368us (447us total) trans 0 rc 301/301 00000100:00100000:1.0:1787096599.038205:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 281 00000100:00100000:0.0:1787096599.039377:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1787096599.039417:0:9989:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345530496 00000100:00100000:3.0:1787096599.039422:0:9989:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345530496 00000100:00100000:3.0:1787096599.039488:0:9989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 282 00000100:00100000:3.0:1787096599.039494:0:9989:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742c99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:70e19547-606a-4706-b016-3476e377d7df+11:37969:x1873906345530496:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1787096599.039503:0:9989:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787096599.039504:0:9989:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787096599.039517:0:9989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf5800/0xa979d75fc166c7e3 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2278 expref: 11 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096599.039530:0:9989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x7:0x0].0x0 (ffff961848fbf600) 00010000:00010000:3.0:1787096599.039538:0:9989:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787096599.039548:0:9989:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff961840031c00/0xa979d75fc166c7ff lrc: 2/0,0 mode: --/CW res: [0x240000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2ded7f867b2286 expref: -99 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096599.039617:0:9989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff961840030c00/0xa979d75fc166c806 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096599.039627:0:9989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff961840030c00/0xa979d75fc166c806 lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096599.039634:0:9989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff961840030c00/0xa979d75fc166c806 lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096599.039644:0:9989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff961840030000/0xa979d75fc166c80d lrc: 3/0,1 mode: --/PW res: [0x240000401:0x7:0x0].0x91dd68a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096599.039650:0:9989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff961840030000/0xa979d75fc166c80d lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x7:0x0].0x91dd68a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096599.039661:0:9989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff961840030000/0xa979d75fc166c80d lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x7:0x0].0x91dd68a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096599.039990:0:9989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff961840030e00/0xa979d75fc166c814 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096599.039997:0:9989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff961840030e00/0xa979d75fc166c814 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096599.040002:0:9989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff961840030e00/0xa979d75fc166c814 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787096599.040008:0:9989:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000402:0x9:0x0]: returning size 0 00010000:00010000:3.0:1787096599.040031:0:9989:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff961840030c00/0xa979d75fc166c806 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096599.040038:0:9989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff961840030c00/0xa979d75fc166c806 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096599.040044:0:9989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff961840030c00/0xa979d75fc166c806 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096599.040049:0:9989:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff961840030c00/0xa979d75fc166c806 lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096599.040055:0:9989:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961840030c00 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:3.0:1787096599.040059:0:9989:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff961840030c00/0xa979d75fc166c806 lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096599.040066:0:9989:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff961840030c00/0xa979d75fc166c806 lrc: 5/0,0 mode: CW/CW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096599.040074:0:9989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x7:0x0].0x0 (ffff961843e27000) 00010000:00010000:3.0:1787096599.040077:0:9989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096599.040092:0:9989:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff961840030c00/0xa979d75fc166c806 lrc: 3/0,0 mode: --/CW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096599.040099:0:9989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff961840030c00/0xa979d75fc166c806 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787096599.040109:0:9989:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000076f6f791 reply state 00000000eff50cd1 transno 4294967348 ns: mdt-lustre-MDT0001_UUID lock: ffff961840030000/0xa979d75fc166c80d lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x7:0x0].0x91dd68a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096599.040120:0:9989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff961840030000/0xa979d75fc166c80d lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x7:0x0].0x91dd68a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096599.040126:0:9989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x7:0x0].0x91dd68a8 (ffff961843e27d00) 00010000:00010000:3.0:1787096599.040128:0:9989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787096599.040131:0:9989:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787096599.040152:0:9989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff961840031c00/0xa979d75fc166c7ff lrc: 0/0,0 mode: --/CW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2286 expref: 13 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096599.040167:0:9989:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff961840030e00/0xa979d75fc166c814 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2286 expref: 12 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096599.040179:0:9989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x9:0x0].0x0 (ffff961843e27900) 00010000:00010000:3.0:1787096599.040180:0:9989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787096599.040182:0:9989:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961840030e00, rc 0) 00000100:00100000:3.0:1787096599.040213:0:9989:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742c99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:70e19547-606a-4706-b016-3476e377d7df+13:37969:x1873906345530496:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 720us (838us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1787096599.040218:0:9989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 282 00000100:00100000:3.0:1787096599.041271:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1787096599.041312:0:6489:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345530752 00000100:00100000:1.0:1787096599.041323:0:6489:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345530752 00000100:00100000:1.0:1787096599.041354:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 283 00000100:00100000:1.0:1787096599.041361:0:6489:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961848f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70e19547-606a-4706-b016-3476e377d7df+13:37969:x1873906345530752:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1787096599.041372:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096599.041380:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4200/0xa979d75fc166c822 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2ded7f867b228d expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.041423:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf5200/0xa979d75fc166c829 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.041433:0:6489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff961840030e00/0xa979d75fc166c814 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2286 expref: 14 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.041465:0:6489:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf5200/0xa979d75fc166c829 lrc: 4/0,1 mode: --/EX res: [0x240000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.041492:0:6489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff961840030e00/0xa979d75fc166c814 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2286 expref: 14 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.041504:0:6489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff961840030e00/0xa979d75fc166c814 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2286 expref: 14 pid: 9989 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096599.041516:0:6489:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96187c9e5500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6489:1873906354000128:192.168.201.40@tcp:104: 00000100:00100000:1.0:1787096599.041577:0:6489:0:(client.c:2692:ptlrpc_set_wait()) set ffff961846d0c540 going to sleep for 11 seconds 00000100:00100000:1.0:1787096599.042242:0:6489:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96187c9e5500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6489:1873906354000128:192.168.201.40@tcp:104: 00010000:00010000:1.0:1787096599.042258:0:6489:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf5200/0xa979d75fc166c829 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096599.042410:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1787096599.042461:0:8380:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345530880 00000100:00100000:1.0:1787096599.042470:0:8380:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345530880 00010000:00010000:1.0:1787096599.042484:0:8380:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff961840030e00/0xa979d75fc166c814 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2286 expref: 15 pid: 9989 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096599.042510:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 88 00000100:00100000:1.0:1787096599.042516:0:8380:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961848f69880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:70e19547-606a-4706-b016-3476e377d7df+15:2401:x1873906345530880:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787096599.042523:0:8380:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787096599.042526:0:8380:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff961840030e00/0xa979d75fc166c814 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2286 expref: 15 pid: 9989 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.042534:0:8380:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff961840030e00/0xa979d75fc166c814 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2286 expref: 15 pid: 9989 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.042543:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff961840030e00/0xa979d75fc166c814 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2286 expref: 15 pid: 9989 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.042550:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x9:0x0].0x0 (ffff961843e27900) 00010000:00010000:1.0:1787096599.042553:0:8380:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf5200/0xa979d75fc166c829 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.042561:0:8380:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf5200/0xa979d75fc166c829 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6489 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.042568:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf5200/0xa979d75fc166c829 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6489 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096599.042595:0:8380:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787096599.042604:0:6489:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf5200/0xa979d75fc166c829 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096599.042611:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf5200/0xa979d75fc166c829 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787096599.042625:0:6489:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000402:0x9:0x0]: returning size 0 00000100:00100000:1.0:1787096599.042630:0:8380:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961848f69880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:70e19547-606a-4706-b016-3476e377d7df+14:2401:x1873906345530880:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 111us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096599.042647:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 88 00010000:00010000:2.0:1787096599.042737:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf5200/0xa979d75fc166c829 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096599.042745:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf5200/0xa979d75fc166c829 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096599.042751:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf5200/0xa979d75fc166c829 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096599.042756:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96186ddf5200 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:2.0:1787096599.042760:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf5200/0xa979d75fc166c829 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096599.042767:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf5200/0xa979d75fc166c829 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096599.042775:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x9:0x0].0x0 (ffff961843e27900) 00010000:00010000:2.0:1787096599.042782:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787096599.042786:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf5200/0xa979d75fc166c829 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096599.042792:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf5200/0xa979d75fc166c829 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096599.042816:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4200/0xa979d75fc166c822 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b228d expref: 13 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096599.042825:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x9:0x0].0x0 (ffff961843e27900) 00010000:00010000:2.0:1787096599.042827:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787096599.042831:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4200/0xa979d75fc166c822 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b228d expref: 13 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096599.042841:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96186ddf4200, rc 0) 00000100:00100000:2.0:1787096599.042870:0:6489:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961848f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70e19547-606a-4706-b016-3476e377d7df+12:37969:x1873906345530752:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1510us (1600us total) trans 0 rc 301/301 00000100:00100000:2.0:1787096599.042878:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 283 00000100:00100000:3.0:1787096599.043782:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1787096599.043829:0:13534:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345531136 00000100:00100000:1.0:1787096599.043833:0:13534:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345531136 00000100:00100000:1.0:1787096599.043858:0:13534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 56 00000100:00100000:1.0:1787096599.043863:0:13534:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961848f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:70e19547-606a-4706-b016-3476e377d7df+12:37969:x1873906345531136:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:1.0:1787096599.043986:0:13534:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961848f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:70e19547-606a-4706-b016-3476e377d7df+13:37969:x1873906345531136:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 122us (206us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1787096599.043991:0:13534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 56 00000001:02000400:2.0:1787096599.515558:0:23550:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-ec test_26b: @@@@@@ FAIL: setstripe failed 00010000:00010000:0.0:1787096599.822597:0:7858:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787096599.837235:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1787096599.837270:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1787096599.837291:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1787096599.837310:0:6482:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345531264 00000100:00100000:1.0:1787096599.837310:0:6488:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345531392 00000100:00100000:3.0:1787096599.837321:0:6482:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345531264 00000100:00100000:1.0:1787096599.837321:0:6488:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345531392 00000100:00100000:2.0:1787096599.837358:0:6490:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345531520 00000100:00100000:2.0:1787096599.837363:0:6490:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345531520 00000100:00100000:3.0:1787096599.837377:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 332 00000100:00100000:1.0:1787096599.837377:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 304 00000100:00100000:1.0:1787096599.837390:0:6488:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742c9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70e19547-606a-4706-b016-3476e377d7df+8:2401:x1873906345531392:12345-192.168.201.40@tcp:400:kworker.0 00000100:00100000:3.0:1787096599.837393:0:6482:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961850223450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d421c913-8ded-4ece-9979-167ed163b87c+9:2400:x1873906345531264:12345-192.168.201.40@tcp:400:kworker.0 00000100:00100000:2.0:1787096599.837410:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 305 00000100:00100000:2.0:1787096599.837421:0:6490:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742c98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70e19547-606a-4706-b016-3476e377d7df+13:2400:x1873906345531520:12345-192.168.201.40@tcp:400:kworker.0 00000100:00100000:3.0:1787096599.837483:0:6482:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961850223450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d421c913-8ded-4ece-9979-167ed163b87c+9:2400:x1873906345531264:12345-192.168.201.40@tcp:400:kworker.0 Request processed in 89us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096599.837483:0:6488:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742c9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70e19547-606a-4706-b016-3476e377d7df+8:2401:x1873906345531392:12345-192.168.201.40@tcp:400:kworker.0 Request processed in 96us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096599.837487:0:6490:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742c98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70e19547-606a-4706-b016-3476e377d7df+13:2400:x1873906345531520:12345-192.168.201.40@tcp:400:kworker.0 Request processed in 68us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096599.837497:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 332 00000100:00100000:1.0:1787096599.837497:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 304 00000100:00100000:2.0:1787096599.837505:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 305 Debug log: 953 lines, 953 kept, 0 dropped, 0 bad.