00010000:00010000:1.0F:1762166748.946612:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166749.000251:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0F:1762166749.000298:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439955456 00000100:00100000:2.0:1762166749.000314:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439955456 00000100:00080000:3.0F:1762166749.000346:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1762166749.000386:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2387 00000100:00100000:2.0:1762166749.000399:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5804000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+7:35708:x1847765439955456:12345-192.168.204.38@tcp:101:rm.0 00010000:00010000:2.0:1762166749.000423:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166749.000441:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0a3b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7367 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166749.000507:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0000/0x2f180c4effb0a3ba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.000517:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0000/0x2f180c4effb0a3ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.000526:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0000/0x2f180c4effb0a3ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:2.0:1762166749.000558:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1762166749.000561:0:7432:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166749.000574:0:7432:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0000/0x2f180c4effb0a3ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.000590:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0a3b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7367 expref: 9 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166749.000601:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0000/0x2f180c4effb0a3ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7367 expref: 8 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166749.000606:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:2.0:1762166749.000609:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1762166749.000611:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0000, rc 0) 00000100:00100000:2.0:1762166749.000659:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5804000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+8:35708:x1847765439955456:12345-192.168.204.38@tcp:101:rm.0 Request processed in 264us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166749.000669:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2387 00000100:00100000:3.0:1762166749.001887:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166749.001950:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439955584 00000100:00100000:2.0:1762166749.001961:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439955584 00000100:00100000:2.0:1762166749.002024:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2388 00000100:00100000:2.0:1762166749.002037:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+8:35708:x1847765439955584:12345-192.168.204.38@tcp:101:rm.0 00010000:00010000:2.0:1762166749.002060:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166749.002081:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0a3c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b736e expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166749.002159:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1a00/0x2f180c4effb0a3c8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.002174:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1a00/0x2f180c4effb0a3c8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.002187:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1a00/0x2f180c4effb0a3c8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.002202:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0a3cf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71939024 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.002208:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0a3cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71939024 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.002215:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0a3cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71939024 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.002307:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0a3d6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.002315:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0a3d6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.002341:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0a3d6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:2.0:1762166749.002390:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0xb:0x0]: returning size 1048577 00000004:00200000:2.0:1762166749.002395:0:7432:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166749.002415:0:7432:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0a3d6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.002427:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0a3d6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.002437:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1a00/0x2f180c4effb0a3c8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.002444:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1a00/0x2f180c4effb0a3c8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.002449:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1a00/0x2f180c4effb0a3c8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.002463:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1a00/0x2f180c4effb0a3c8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.002472:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166749.002961:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1a00/0x2f180c4effb0a3c8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.002971:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1a00/0x2f180c4effb0a3c8 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.002985:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:2.0:1762166749.002988:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166749.002994:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1a00/0x2f180c4effb0a3c8 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.003007:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1a00/0x2f180c4effb0a3c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.003022:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0a3cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71939024 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.003027:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0a3cf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71939024 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.003034:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0a3cf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71939024 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.003039:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166749.003042:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0a3cf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71939024 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.003048:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0a3cf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71939024 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.003056:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71939024 (ffff945cf39a3300) 00010000:00010000:2.0:1762166749.003058:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166749.003061:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0a3cf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71939024 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.003067:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0a3cf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71939024 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.003106:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0a3c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b736e expref: 10 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166749.003122:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0a3d6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b736e expref: 9 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166749.003152:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff945bc580ad00) 00010000:00010000:2.0:1762166749.003155:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166749.003159:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b1e00, rc 0) 00000100:00100000:2.0:1762166749.003238:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+9:35708:x1847765439955584:12345-192.168.204.38@tcp:101:rm.0 Request processed in 1204us (1360us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166749.003247:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2388 00000100:00100000:1.0:1762166749.005247:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166749.005356:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439955712 00000100:00100000:2.0:1762166749.005376:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439955712 00000100:00080000:0.0F:1762166749.005444:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1762166749.005467:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 844 00000100:00100000:2.0:1762166749.005523:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5804380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c5f20b66-016a-4159-9d62-071c0da3ef0b+5:2418:x1847765439955712:12345-192.168.204.38@tcp:101:rm.0 00010000:00010000:2.0:1762166749.005543:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166749.005566:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0a3dd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7375 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166749.005585:0:28874:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1762166749.005604:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166749.005607:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166749.005618:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0a3dd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7375 expref: 6 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166749.005637:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0a3dd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7375 expref: 6 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166749.005648:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b1200, rc 0) 00000100:00100000:2.0:1762166749.005720:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5804380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c5f20b66-016a-4159-9d62-071c0da3ef0b+6:2418:x1847765439955712:12345-192.168.204.38@tcp:101:rm.0 Request processed in 243us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166749.005737:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 844 00000100:00100000:1.0:1762166749.007674:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166749.007715:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439955968 00000100:00100000:2.0:1762166749.007724:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439955968 00000100:00100000:2.0:1762166749.007784:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2389 00000100:00100000:2.0:1762166749.007795:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5804e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+9:35708:x1847765439955968:12345-192.168.204.38@tcp:36:rm.0 00010000:00010000:2.0:1762166749.007858:0:7432:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1762166749.007884:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0a3d6 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b736e expref: 9 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166749.007899:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6c00/0x2f180c4effb0a397 lrc: 0/0,0 mode: --/CR res: [0x200000403:0xb:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7360 expref: 8 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166749.007908:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff945bc580ad00) 00010000:00010000:2.0:1762166749.007935:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0000/0x2f180c4effb0a3ba lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7367 expref: 7 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166749.007945:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:2.0:1762166749.007951:0:7432:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166749.007974:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0a3e4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.007986:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0a3e4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.007997:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0a3e4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.008013:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0a3eb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x71939024 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.008035:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0a3eb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71939024 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.008043:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0a3eb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71939024 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.008125:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1c00/0x2f180c4effb0a3f2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.008131:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1c00/0x2f180c4effb0a3f2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.008135:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1c00/0x2f180c4effb0a3f2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000040:00080000:2.0:1762166749.008381:0:7432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].93, 64 off15800 00000004:00080000:2.0:1762166749.008394:0:7432:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 368156915419ns, next at 369156911727ns, rc = 0 00000040:00080000:2.0:1762166749.008424:0:7432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].90, 64 off15536 00000004:00080000:2.0:1762166749.008432:0:7432:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 368156953807ns, next at 369156951493ns, rc = 0 00010000:00010000:2.0:1762166749.008519:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0a3f9 lrc: 3/0,1 mode: --/PW res: [0x200000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.008528:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0a3f9 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.008536:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0a3f9 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.008543:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0a3f9 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.008548:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0a3f9 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.008570:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0a3f9 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.008594:0:7432:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166749.008613:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1c00/0x2f180c4effb0a3f2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.008619:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1c00/0x2f180c4effb0a3f2 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.008624:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1c00/0x2f180c4effb0a3f2 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166749.008626:0:7420:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166749.008632:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166749.008636:0:7420:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0a3f9 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.008638:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1c00/0x2f180c4effb0a3f2 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166749.008654:0:7420:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166749.008656:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1c00/0x2f180c4effb0a3f2 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166749.008659:0:7420:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0a3f9 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.008670:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff945cf39a3500) 00010000:00010000:2.0:1762166749.008673:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1762166749.008676:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1c00/0x2f180c4effb0a3f2 lrc: 2/0,0 mode: --/EX res: [0x200000403:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166749.008680:0:7420:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0a3f9 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.008685:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1c00/0x2f180c4effb0a3f2 lrc: 0/0,0 mode: --/EX res: [0x200000403:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166749.008697:0:7420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff945cf39a3500) 00010000:00010000:0.0:1762166749.008702:0:7420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1762166749.008708:0:7420:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0a3f9 lrc: 1/0,0 mode: --/PW res: [0x200000403:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166749.008716:0:7420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0a3f9 lrc: 0/0,0 mode: --/PW res: [0x200000403:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166749.008745:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166749.008748:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166749.008750:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166749.008877:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0a3e4 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.008884:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0a3e4 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.008905:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0a3e4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.008910:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0a3e4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.008914:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166749.008917:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0a3e4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.008923:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0a3e4 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.008931:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:2.0:1762166749.008934:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166749.008937:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0a3e4 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.008943:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0a3e4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00000004:00010000:2.0:1762166749.008953:0:7432:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000094a13476 reply state 0000000049dbf2ea transno 4294968782 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0a3eb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71939024 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.008963:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0a3eb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x71939024 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.008969:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71939024 (ffff945cf39a3f00) 00010000:00010000:2.0:1762166749.008971:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166749.008974:0:7432:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166749.009066:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5804e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+8:35708:x1847765439955968:12345-192.168.204.38@tcp:36:rm.0 Request processed in 1273us (1397us total) trans 4294968782 rc 0/0 00000100:00100000:2.0:1762166749.009085:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2389 00000100:00100000:0.0:1762166749.010750:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166749.010820:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439956096 00000100:00100000:2.0:1762166749.010829:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439956096 00000100:00100000:2.0:1762166749.010887:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2390 00000100:00100000:2.0:1762166749.010897:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+8:35708:x1847765439956096:12345-192.168.204.38@tcp:101:rm.0 00010000:00010000:2.0:1762166749.010918:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166749.010935:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1600/0x2f180c4effb0a400 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b737c expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166749.010999:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0a407 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.011012:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0a407 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.011023:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0a407 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:2.0:1762166749.011060:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1762166749.011064:0:7432:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166749.011082:0:7432:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0a407 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.011105:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1600/0x2f180c4effb0a400 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b737c expref: 10 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166749.011121:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0a407 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b737c expref: 9 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166749.011129:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:2.0:1762166749.011153:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1762166749.011157:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b1000, rc 0) 00000100:00100000:2.0:1762166749.011203:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+9:35708:x1847765439956096:12345-192.168.204.38@tcp:101:rm.0 Request processed in 308us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166749.011210:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2390 00000100:00100000:1.0:1762166749.012650:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166749.012713:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439956224 00000100:00100000:3.0:1762166749.012722:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439956224 00000100:00100000:3.0:1762166749.012770:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2391 00000100:00100000:3.0:1762166749.012785:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5807480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+9:35708:x1847765439956224:12345-192.168.204.38@tcp:101:rm.0 00010000:00010000:3.0:1762166749.012802:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166749.012817:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc7400/0x2f180c4effb0a40e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7383 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166749.012867:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6e00/0x2f180c4effb0a415 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166749.012877:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6e00/0x2f180c4effb0a415 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166749.012885:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6e00/0x2f180c4effb0a415 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166749.012894:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc7c00/0x2f180c4effb0a41c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdf5e0693 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166749.012898:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc7c00/0x2f180c4effb0a41c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdf5e0693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166749.012903:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc7c00/0x2f180c4effb0a41c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdf5e0693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166749.012970:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6200/0x2f180c4effb0a423 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166749.012977:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6200/0x2f180c4effb0a423 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xc:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166749.012983:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6200/0x2f180c4effb0a423 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xc:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:3.0:1762166749.013030:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0xc:0x0]: returning size 0 00000004:00200000:3.0:1762166749.013034:0:7432:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166749.013051:0:7432:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6200/0x2f180c4effb0a423 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xc:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166749.013060:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6200/0x2f180c4effb0a423 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166749.013068:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6e00/0x2f180c4effb0a415 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166749.013074:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6e00/0x2f180c4effb0a415 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166749.013080:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6e00/0x2f180c4effb0a415 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166749.013086:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6e00/0x2f180c4effb0a415 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166749.013092:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3dc6e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166749.013096:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6e00/0x2f180c4effb0a415 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166749.013103:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6e00/0x2f180c4effb0a415 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166749.013114:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:3.0:1762166749.013116:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166749.013120:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6e00/0x2f180c4effb0a415 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166749.013126:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6e00/0x2f180c4effb0a415 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166749.013160:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc7c00/0x2f180c4effb0a41c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdf5e0693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166749.013166:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc7c00/0x2f180c4effb0a41c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdf5e0693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166749.013174:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc7c00/0x2f180c4effb0a41c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdf5e0693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166749.013178:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3dc7c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166749.013182:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc7c00/0x2f180c4effb0a41c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdf5e0693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166749.013188:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc7c00/0x2f180c4effb0a41c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdf5e0693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166749.013197:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdf5e0693 (ffff945bc580a000) 00010000:00010000:3.0:1762166749.013200:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166749.013203:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc7c00/0x2f180c4effb0a41c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdf5e0693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166749.013209:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc7c00/0x2f180c4effb0a41c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdf5e0693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166749.013242:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc7400/0x2f180c4effb0a40e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7383 expref: 11 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166749.013255:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6200/0x2f180c4effb0a423 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7383 expref: 10 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166749.013263:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xc:0x0].0x0 (ffff945bc580a200) 00010000:00010000:3.0:1762166749.013272:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166749.013275:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3dc6200, rc 0) 00000100:00100000:3.0:1762166749.013344:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5807480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+10:35708:x1847765439956224:12345-192.168.204.38@tcp:101:rm.0 Request processed in 565us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166749.013352:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2391 00000100:00100000:1.0:1762166749.015676:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166749.015739:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439956352 00000100:00100000:2.0:1762166749.015752:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439956352 00000100:00080000:0.0:1762166749.015802:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1762166749.015827:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 845 00000100:00100000:2.0:1762166749.015839:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5807800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c5f20b66-016a-4159-9d62-071c0da3ef0b+6:2417:x1847765439956352:12345-192.168.204.38@tcp:101:rm.0 00010000:00010000:2.0:1762166749.015855:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166749.015874:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1800/0x2f180c4effb0a42a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b738a expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166749.015977:0:28874:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1762166749.015996:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166749.015998:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166749.016008:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1800/0x2f180c4effb0a42a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b738a expref: 7 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166749.016028:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1800/0x2f180c4effb0a42a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b738a expref: 7 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166749.016041:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b1800, rc 0) 00000100:00100000:2.0:1762166749.016099:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5807800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c5f20b66-016a-4159-9d62-071c0da3ef0b+7:2417:x1847765439956352:12345-192.168.204.38@tcp:101:rm.0 Request processed in 263us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166749.016107:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 845 00000100:00100000:0.0:1762166749.017747:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166749.017860:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439956608 00000100:00100000:2.0:1762166749.017877:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439956608 00000100:00100000:2.0:1762166749.017972:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2392 00000100:00100000:2.0:1762166749.017985:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+10:35708:x1847765439956608:12345-192.168.204.38@tcp:36:rm.0 00010000:00010000:2.0:1762166749.018057:0:7432:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1762166749.018093:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6200/0x2f180c4effb0a423 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7383 expref: 10 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166749.018120:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xc:0x0].0x0 (ffff945bc580a200) 00010000:00010000:2.0:1762166749.018162:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0a407 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b737c expref: 9 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166749.018175:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:2.0:1762166749.018179:0:7432:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166749.018218:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0a431 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.018236:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0a431 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.018248:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0a431 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.018271:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1a00/0x2f180c4effb0a438 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xdf5e0693 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.018279:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1a00/0x2f180c4effb0a438 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdf5e0693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.018286:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1a00/0x2f180c4effb0a438 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdf5e0693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.018401:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1400/0x2f180c4effb0a43f lrc: 3/0,1 mode: --/EX res: [0x200000403:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.018427:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1400/0x2f180c4effb0a43f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.018434:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1400/0x2f180c4effb0a43f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000040:00080000:2.0:1762166749.018895:0:7432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].94, 64 off15864 00000040:00080000:2.0:1762166749.018929:0:7432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].91, 64 off15600 00000040:00080000:2.0:1762166749.018947:0:7432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].95, 64 off15928 00010000:00010000:2.0:1762166749.019023:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1600/0x2f180c4effb0a446 lrc: 3/0,1 mode: --/PW res: [0x200000403:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.019032:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1600/0x2f180c4effb0a446 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.019041:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1600/0x2f180c4effb0a446 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.019049:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1600/0x2f180c4effb0a446 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.019056:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1600/0x2f180c4effb0a446 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.019062:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1600/0x2f180c4effb0a446 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.019096:0:7432:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166749.019122:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1400/0x2f180c4effb0a43f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.019129:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1400/0x2f180c4effb0a43f lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.019135:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1400/0x2f180c4effb0a43f lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.019160:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166749.019165:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1400/0x2f180c4effb0a43f lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.019175:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1400/0x2f180c4effb0a43f lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166749.019180:0:6482:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166749.019186:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xc:0x0].0x0 (ffff945cf39a3000) 00010000:00010000:2.0:1762166749.019193:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1762166749.019193:0:6482:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1600/0x2f180c4effb0a446 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.019202:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1400/0x2f180c4effb0a43f lrc: 2/0,0 mode: --/EX res: [0x200000403:0xc:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166749.019211:0:6482:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166749.019214:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1400/0x2f180c4effb0a43f lrc: 0/0,0 mode: --/EX res: [0x200000403:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166749.019219:0:6482:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1600/0x2f180c4effb0a446 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0xc:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166749.019236:0:6482:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1600/0x2f180c4effb0a446 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166749.019261:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xc:0x0].0x0 (ffff945cf39a3000) 00010000:00010000:1.0:1762166749.019264:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1762166749.019270:0:6482:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1600/0x2f180c4effb0a446 lrc: 1/0,0 mode: --/PW res: [0x200000403:0xc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166749.019276:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1600/0x2f180c4effb0a446 lrc: 0/0,0 mode: --/PW res: [0x200000403:0xc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166749.019301:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166749.019304:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166749.019305:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166749.019422:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0a431 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.019428:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0a431 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.019431:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0a431 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.019435:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0a431 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.019437:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166749.019439:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0a431 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.019443:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0a431 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.019458:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:2.0:1762166749.019460:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166749.019463:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0a431 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.019466:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0a431 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00000004:00010000:2.0:1762166749.019472:0:7432:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000eb01804b reply state 000000003958540e transno 4294968783 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1a00/0x2f180c4effb0a438 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdf5e0693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.019511:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1a00/0x2f180c4effb0a438 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdf5e0693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166749.019516:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdf5e0693 (ffff945cf39a3700) 00010000:00010000:2.0:1762166749.019518:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166749.019520:0:7432:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166749.019608:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+10:35708:x1847765439956608:12345-192.168.204.38@tcp:36:rm.0 Request processed in 1625us (1874us total) trans 4294968783 rc 0/0 00000100:00100000:2.0:1762166749.019620:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2392 00000100:00100000:3.0:1762166749.458608:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446763008:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1762166749.458671:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166749.458705:0:8385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446763008 00000100:00100000:0.0:1762166749.458712:0:8385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446763008 00000100:00080000:2.0:1762166749.458759:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1762166749.458762:0:8385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1762166749.458771:0:8385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+14:3636:x1847765446763008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1762166749.458792:0:8385:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 25592384 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1762166749.458832:0:8385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+14:3636:x1847765446763008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166749.458845:0:8385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1762166749.458876:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446763008:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1762166749.459561:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1762166749.459573:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446763136:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1762166749.459608:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166749.459650:0:8385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446763136 00000100:00100000:1.0:1762166749.459654:0:8385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446763136 00000100:00100000:1.0:1762166749.459697:0:8385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1762166749.459704:0:8385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1847765446763136:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1762166749.459717:0:8385:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 25592384 pending 0 free 3923492864 avail 3691970560 00000100:00080000:0.0:1762166749.459722:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1762166749.459764:0:8385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1847765446763136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166749.459771:0:8385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1762166749.459799:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446763136:0@lo:13:osp-pre-1-1.0 00000001:02000400:3.0:1762166749.583474:0:29304:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-flr test 42: lfs mirror verify ================= 05:45:49 (1762166749) 00010000:00010000:1.0:1762166749.970658:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166749.970689:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446763264:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1762166749.970760:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166749.970839:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446763264 00000100:00100000:1.0:1762166749.970846:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446763264 00000100:00100000:1.0:1762166749.970901:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 518 00000100:00100000:1.0:1762166749.970912:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3634:x1847765446763264:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1762166749.970945:0:7427:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446076416 avail 1299836928 00000100:00100000:1.0:1762166749.971003:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3634:x1847765446763264:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166749.971011:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 518 00000100:00100000:0.0:1762166749.971359:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446763264:0@lo:41:osp-pre-0-1.0 00000001:00080000:1.0:1762166749.971968:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869308 is committed 00000001:00080000:2.0:1762166749.971974:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836619 is committed 00000001:00080000:1.0:1762166749.971981:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869305 is committed 00000001:02000400:2.0:1762166750.113207:0:29352:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-flr test_42 need >= 4 OSTs 00000100:00100000:0.0:1762166750.482713:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446763392:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1762166750.482793:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166750.482853:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446763392 00000100:00100000:1.0:1762166750.482863:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446763392 00000100:00100000:1.0:1762166750.482912:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 519 00000100:00100000:1.0:1762166750.482933:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1847765446763392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1762166750.482967:0:7427:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:1.0:1762166750.483018:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1847765446763392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166750.483025:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 519 00000100:00100000:0.0:1762166750.483045:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446763392:0@lo:41:osp-pre-1-0.0 00000001:02000400:2.0:1762166750.709920:0:29401:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-flr test 43a: mirror pick on write ============= 05:45:50 (1762166750) 00010000:00010000:1.0:1762166750.995547:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1762166751.226496:0:29449:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-flr test_43a needs >= 3 OSTs 00000100:00100000:1.0:1762166751.501210:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166751.501243:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166751.501270:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166751.501293:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166751.501300:0:6489:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439956736 00000100:00100000:0.0:1762166751.501312:0:6489:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439956736 00000100:00100000:1.0:1762166751.501324:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166751.501342:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439957248 00000100:00100000:3.0:1762166751.501348:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439957248 00000100:00100000:0.0:1762166751.501367:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 556 00000100:00100000:0.0:1762166751.501380:0:6489:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7d14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:332e157a-5c6a-4389-857f-15641f8aa9a8+9:2419:x1847765439956736:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1762166751.501393:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439956992 00000100:00100000:1.0:1762166751.501395:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439956864 00000100:00100000:3.0:1762166751.501397:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439957120 00000100:00100000:1.0:1762166751.501399:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439956864 00000100:00100000:2.0:1762166751.501400:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439956992 00000100:00100000:3.0:1762166751.501403:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439957120 00000100:00100000:3.0:1762166751.501442:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 214 00000100:00100000:2.0:1762166751.501447:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 356 00000100:00100000:3.0:1762166751.501455:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c5f20b66-016a-4159-9d62-071c0da3ef0b+6:2419:x1847765439957248:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1762166751.501456:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 357 00000100:00100000:2.0:1762166751.501457:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+5:2419:x1847765439956992:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1762166751.501464:0:6489:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7d14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:332e157a-5c6a-4389-857f-15641f8aa9a8+9:2419:x1847765439956736:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 84us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166751.501469:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+10:2419:x1847765439956864:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1762166751.501508:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 556 00000100:00100000:2.0:1762166751.501528:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+5:2419:x1847765439956992:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 73us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166751.501547:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c5f20b66-016a-4159-9d62-071c0da3ef0b+6:2419:x1847765439957248:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 93us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166751.501547:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+10:2419:x1847765439956864:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 81us (251us total) trans 0 rc 0/0 00000100:00080000:0.0:1762166751.501549:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1762166751.501553:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 356 00000100:00080000:0.0:1762166751.501558:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1762166751.501563:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 357 00000100:00080000:0.0:1762166751.501564:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1762166751.501569:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 214 00000100:00080000:0.0:1762166751.501571:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1762166751.501588:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 215 00000100:00100000:2.0:1762166751.501599:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+6:2419:x1847765439957120:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1762166751.501627:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+6:2419:x1847765439957120:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 31us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166751.501634:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 215 00000001:02000400:0.0:1762166751.790363:0:29497:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-flr test 43b: allow writing to multiple preferred mirror file ========================================================== 05:45:51 (1762166751) 00000100:00100000:1.0:1762166751.830027:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166751.830071:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439957376 00000100:00100000:0.0:1762166751.830081:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439957376 00000100:00100000:0.0:1762166751.830151:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2393 00000100:00100000:0.0:1762166751.830162:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+10:36456:x1847765439957376:12345-192.168.204.38@tcp:41:stat.0 00000004:00000024:0.0:1762166751.830210:0:6496:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 7845928960 avail 7382884352 00000100:00100000:0.0:1762166751.830286:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+10:36456:x1847765439957376:12345-192.168.204.38@tcp:41:stat.0 Request processed in 126us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166751.830294:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2393 00000100:00100000:0.0:1762166751.849381:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166751.849444:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439957504 00000100:00100000:1.0:1762166751.849454:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439957504 00000100:00100000:1.0:1762166751.849954:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2394 00000100:00100000:1.0:1762166751.849969:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+10:36464:x1847765439957504:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166751.849989:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166751.850010:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0a44d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7391 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166751.850074:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0a454 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166751.850101:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0a454 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166751.850113:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0a454 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:1.0:1762166751.850166:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1762166751.850171:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166751.850190:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0a454 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166751.850219:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0a44d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7391 expref: 12 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166751.850240:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0a454 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7391 expref: 11 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166751.850256:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:1.0:1762166751.850260:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1762166751.850264:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf786b600, rc 0) 00000100:00100000:1.0:1762166751.850332:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+11:36464:x1847765439957504:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 357us (947us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166751.850345:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2394 00000100:00100000:1.0:1762166751.851833:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166751.852129:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439957632 00000100:00100000:2.0:1762166751.852137:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439957632 00000100:00100000:2.0:1762166751.852189:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2395 00000100:00100000:2.0:1762166751.852200:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+11:36464:x1847765439957632:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166751.852215:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166751.852230:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1c00/0x2f180c4effb0a45b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7398 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.852279:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0000/0x2f180c4effb0a462 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.852290:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0000/0x2f180c4effb0a462 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.852300:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0000/0x2f180c4effb0a462 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.852326:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0a469 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6a87ace7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.852335:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0a469 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6a87ace7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.852351:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0a469 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6a87ace7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.852393:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0000/0x2f180c4effb0a462 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.852400:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0000/0x2f180c4effb0a462 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.852406:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0000/0x2f180c4effb0a462 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.852413:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166751.852418:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0000/0x2f180c4effb0a462 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.852425:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0000/0x2f180c4effb0a462 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.852437:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:2.0:1762166751.852440:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166751.852444:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0000/0x2f180c4effb0a462 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.852450:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0000/0x2f180c4effb0a462 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.852460:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0a469 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6a87ace7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.852466:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0a469 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6a87ace7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.852472:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0a469 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6a87ace7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.852505:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166751.852509:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0a469 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6a87ace7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.852515:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0a469 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6a87ace7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.852526:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6a87ace7 (ffff945bc477f400) 00010000:00010000:2.0:1762166751.852529:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166751.852532:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0a469 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6a87ace7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.852537:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0a469 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6a87ace7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.852570:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1c00/0x2f180c4effb0a45b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7398 expref: 12 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.852580:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:2.0:1762166751.852584:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166751.852588:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1c00/0x2f180c4effb0a45b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7398 expref: 12 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.852597:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b1c00, rc 0) 00000100:00100000:2.0:1762166751.852645:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+11:36464:x1847765439957632:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 447us (818us total) trans 0 rc 301/301 00000100:00100000:2.0:1762166751.852652:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2395 00000100:00100000:1.0:1762166751.855123:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166751.855162:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439957760 00000100:00100000:3.0:1762166751.855171:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439957760 00000100:00100000:3.0:1762166751.855219:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 5 00000100:00100000:3.0:1762166751.855230:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:c5f20b66-016a-4159-9d62-071c0da3ef0b+5:36464:x1847765439957760:12345-192.168.204.38@tcp:700:lfs.0 00000100:00100000:3.0:1762166751.855297:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:c5f20b66-016a-4159-9d62-071c0da3ef0b+5:36464:x1847765439957760:12345-192.168.204.38@tcp:700:lfs.0 Request processed in 70us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166751.855303:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 5 00000100:00100000:1.0:1762166751.856299:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166751.856369:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439958016 00000100:00100000:2.0:1762166751.856375:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439958016 00000100:00100000:2.0:1762166751.856421:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2396 00000100:00100000:2.0:1762166751.856430:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+5:36464:x1847765439958016:12345-192.168.204.38@tcp:36:lfs.0 00000100:00100000:2.0:1762166751.856573:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd3100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6496:1847765446763520:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1762166751.856618:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166751.856659:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446763520 00000100:00100000:1.0:1762166751.856664:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446763520 00000100:00100000:2.0:1762166751.856670:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc37313c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166751.856705:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 520 00000100:00100000:1.0:1762166751.856712:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:6496:x1847765446763520:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1762166751.856783:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:6496:x1847765446763520:12345-0@lo:1000:mdt00_002.0 Request processed in 71us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166751.856795:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 520 00000100:00100000:2.0:1762166751.856855:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd3100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6496:1847765446763520:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1762166751.856901:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd3100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6496:1847765446763648:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1762166751.856936:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166751.856955:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc37313c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166751.856980:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446763648 00000100:00100000:1.0:1762166751.856985:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446763648 00000100:00100000:1.0:1762166751.857007:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 521 00000100:00100000:1.0:1762166751.857011:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:6496:x1847765446763648:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1762166751.857070:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:6496:x1847765446763648:12345-0@lo:1000:mdt00_002.0 Request processed in 57us (145us total) trans 0 rc -2/-2 00000100:00100000:1.0:1762166751.857078:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 521 00000100:00100000:2.0:1762166751.857102:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd3100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6496:1847765446763648:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1762166751.857139:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc60b0200/0x2f180c4effb0a470 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.857146:0:6496:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc60b0200/0x2f180c4effb0a470 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.857153:0:6496:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc60b0200/0x2f180c4effb0a470 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 6496 initiator: MDT1 00000100:00100000:2.0:1762166751.857164:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd3100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6496:1847765446763776:0@lo:101:mdt00_002.0 00000100:00100000:2.0:1762166751.857185:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166751.857204:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc3731780 going to sleep for 11 seconds 00000100:00100000:1.0:1762166751.857210:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446763776 00000100:00100000:1.0:1762166751.857214:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446763776 00000100:00100000:1.0:1762166751.857234:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 522 00000100:00100000:1.0:1762166751.857238:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:6496:x1847765446763776:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1762166751.857245:0:7427:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166751.857254:0:7427:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0a477 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f180c4effb0a470 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166751.857271:0:7427:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0a454 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7391 expref: 10 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166751.857278:0:7427:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0a477 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x2f180c4effb0a470 expref: 7 pid: 7427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166751.857294:0:7427:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0a454 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7391 expref: 10 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166751.857302:0:7427:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0a454 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7391 expref: 10 pid: 6496 timeout: 471 lvb_type: 0 00000100:00100000:1.0:1762166751.857309:0:7427:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc0380 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:7427:1847765446763904:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166751.857364:0:7427:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc3ea6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1762166751.858315:0:7427:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc0380 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:7427:1847765446763904:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166751.858329:0:7427:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0a477 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb0a470 expref: 7 pid: 7427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166751.858337:0:7427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:0.0:1762166751.858339:0:7427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166751.858342:0:7427:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0a477 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb0a470 expref: 7 pid: 7427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166751.858348:0:7427:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf786ae00, rc 0) 00000100:00100000:0.0:1762166751.858386:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:6496:x1847765446763776:12345-0@lo:101:mdt00_002.0 Request processed in 1146us (1199us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166751.858393:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 522 00000100:00100000:2.0:1762166751.858414:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd3100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6496:1847765446763776:0@lo:101:mdt00_002.0 00010000:00010000:2.0:1762166751.858430:0:6496:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc60b0200/0x2f180c4effb0a470 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0a477 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.858439:0:6496:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc60b0200/0x2f180c4effb0a470 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x2f180c4effb0a477 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166751.858713:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166751.858953:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439958144 00000100:00100000:3.0:1762166751.858959:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439958144 00010000:00010000:3.0:1762166751.858984:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0a454 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7391 expref: 11 pid: 6496 timeout: 471 lvb_type: 0 00000100:00100000:3.0:1762166751.859015:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 555 00000100:00100000:3.0:1762166751.859023:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+11:2418:x1847765439958144:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166751.859034:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166751.859041:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0a454 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7391 expref: 11 pid: 6496 timeout: 471 lvb_type: 0 00010000:00010000:3.0:1762166751.859053:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0a454 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7391 expref: 11 pid: 6496 timeout: 471 lvb_type: 0 00010000:00010000:3.0:1762166751.859071:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0a454 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7391 expref: 11 pid: 6496 timeout: 471 lvb_type: 0 00010000:00010000:3.0:1762166751.859097:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:3.0:1762166751.859102:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0a477 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb0a470 expref: 6 pid: 7427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166751.859111:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0a477 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x2f180c4effb0a470 expref: 6 pid: 7427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166751.859119:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0a477 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x2f180c4effb0a470 expref: 6 pid: 7427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166751.859144:0:8398:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0a477 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb0a470 expref: 6 pid: 7427 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166751.859166:0:8398:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1e6f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:8398:1847765446764032:0@lo:105: 00000100:00100000:3.0:1762166751.859196:0:8398:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166751.859229:0:8398:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cd1ae6c00 going to sleep for 11 seconds 00000100:00100000:0.0:1762166751.859238:0:6478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446764032 00000100:00100000:0.0:1762166751.859242:0:6478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446764032 00000100:00100000:0.0:1762166751.859271:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1762166751.859278:0:6478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:8398:x1847765446764032:12345-0@lo:105: 00010000:00010000:0.0:1762166751.859288:0:6478:0:(ldlm_lockd.c:2517:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc60b0200/0x2f180c4effb0a470 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x2f180c4effb0a477 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166751.859298:0:6478:0:(ldlm_lockd.c:1967:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc60b0200/0x2f180c4effb0a470 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x2f180c4effb0a477 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166751.859307:0:6478:0:(ldlm_lockd.c:2044:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc60b0200/0x2f180c4effb0a470 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0a477 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166751.859333:0:6478:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc60b0200/0x2f180c4effb0a470 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x2f180c4effb0a477 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166751.859340:0:6478:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc60b0200/0x2f180c4effb0a470 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x2f180c4effb0a477 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166751.859348:0:6478:0:(ldlm_lockd.c:2072:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc60b0200/0x2f180c4effb0a470 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x2f180c4effb0a477 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166751.859373:0:6478:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff945bc60b0200) 00010000:00010000:2.0:1762166751.859408:0:6496:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc60b0200/0x2f180c4effb0a470 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x2f180c4effb0a477 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166751.859415:0:6478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:8398:x1847765446764032:12345-0@lo:105: Request processed in 136us (216us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166751.859422:0:6496:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc60b0200/0x2f180c4effb0a470 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x2f180c4effb0a477 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166751.859427:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000004:00080000:2.0:1762166751.859449:0:6496:0:(osp_object.c:1389:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1762166751.859472:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc60b1000/0x2f180c4effb0a47e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6a87ace7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.859520:0:6496:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc60b1000/0x2f180c4effb0a47e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6a87ace7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.859529:0:6496:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc60b1000/0x2f180c4effb0a47e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6a87ace7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6496 initiator: MDT1 00000100:00100000:2.0:1762166751.859543:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd3100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6496:1847765446764160:0@lo:101:mdt00_002.0 00000100:00100000:2.0:1762166751.859568:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166751.859587:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc3731780 going to sleep for 11 seconds 00000100:00100000:0.0:1762166751.859611:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446764160 00000100:00100000:0.0:1762166751.859617:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446764160 00000100:00100000:0.0:1762166751.859657:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 523 00000100:00100000:3.0:1762166751.859658:0:8398:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1e6f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:8398:1847765446764032:0@lo:105: 00000100:00100000:0.0:1762166751.859669:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:6496:x1847765446764160:12345-0@lo:101:mdt00_002.0 00010000:00010000:3.0:1762166751.859674:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166751.859683:0:7427:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1762166751.859712:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+10:2418:x1847765439958144:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 688us (998us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166751.859714:0:7427:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89c00/0x2f180c4effb0a485 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6a87ace7 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f180c4effb0a47e expref: -99 pid: 7427 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166751.859730:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 555 00010000:00010000:0.0:1762166751.859743:0:7427:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89c00/0x2f180c4effb0a485 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6a87ace7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x2f180c4effb0a47e expref: 8 pid: 7427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166751.859756:0:7427:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89c00/0x2f180c4effb0a485 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6a87ace7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb0a47e expref: 8 pid: 7427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166751.859764:0:7427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6a87ace7 (ffff945bc403aa00) 00010000:00010000:0.0:1762166751.859773:0:7427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166751.859777:0:7427:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bccb89c00, rc 0) 00000100:00100000:0.0:1762166751.859820:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:6496:x1847765446764160:12345-0@lo:101:mdt00_002.0 Request processed in 154us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166751.859828:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 523 00000100:00100000:1.0:1762166751.859855:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd3100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6496:1847765446764160:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1762166751.859866:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc60b1000/0x2f180c4effb0a47e lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6a87ace7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0a485 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166751.859875:0:6496:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc60b1000/0x2f180c4effb0a47e lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6a87ace7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x2f180c4effb0a485 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1762166751.859886:0:6496:0:(osp_object.c:1389:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:1.0:1762166751.859915:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6496:1847765446764288:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1762166751.859955:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166751.859979:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc3ea6480 going to sleep for 11 seconds 00000100:00100000:0.0:1762166751.860050:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446764288 00000100:00100000:0.0:1762166751.860055:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446764288 00000100:00100000:0.0:1762166751.860100:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 524 00000100:00100000:0.0:1762166751.860107:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:6496:x1847765446764288:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1762166751.860166:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:6496:x1847765446764288:12345-0@lo:1000:mdt00_002.0 Request processed in 59us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166751.860174:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 524 00000100:00100000:1.0:1762166751.860185:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6496:1847765446764288:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1762166751.860222:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6496:1847765446764416:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1762166751.860244:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166751.860264:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc3ea6480 going to sleep for 11 seconds 00000100:00100000:0.0:1762166751.860277:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446764416 00000100:00100000:0.0:1762166751.860283:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446764416 00000100:00100000:0.0:1762166751.860309:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 525 00000100:00100000:0.0:1762166751.860316:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:6496:x1847765446764416:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1762166751.860390:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:6496:x1847765446764416:12345-0@lo:1000:mdt00_002.0 Request processed in 75us (145us total) trans 0 rc -2/-2 00000100:00100000:0.0:1762166751.860396:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 525 00000100:00100000:1.0:1762166751.860942:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6496:1847765446764416:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1762166751.861009:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6496:1847765446764544:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1762166751.861030:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166751.861052:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc3ea6480 going to sleep for 11 seconds 00000100:00100000:0.0:1762166751.861071:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446764544 00000100:00100000:0.0:1762166751.861077:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446764544 00000100:00100000:0.0:1762166751.861119:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 526 00000100:00100000:0.0:1762166751.861126:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:6496:x1847765446764544:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1762166751.861170:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:6496:x1847765446764544:12345-0@lo:1000:mdt00_002.0 Request processed in 45us (139us total) trans 0 rc -2/-2 00000100:00100000:0.0:1762166751.861174:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 526 00000100:00100000:2.0:1762166751.861208:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6496:1847765446764544:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1762166751.861265:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd3800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6496:1847765446764672:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1762166751.861289:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166751.861325:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc3731b40 going to sleep for 11 seconds 00000100:00100000:1.0:1762166751.861343:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446764672 00000100:00100000:1.0:1762166751.861349:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446764672 00000100:00100000:1.0:1762166751.861381:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 527 00000100:00100000:1.0:1762166751.861389:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:6496:x1847765446764672:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1762166751.861450:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:6496:x1847765446764672:12345-0@lo:1000:mdt00_002.0 Request processed in 61us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166751.861464:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 527 00000100:00100000:2.0:1762166751.861525:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd3800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6496:1847765446764672:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1762166751.861573:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd3800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6496:1847765446764800:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1762166751.861596:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166751.861616:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc3731b40 going to sleep for 11 seconds 00000100:00100000:1.0:1762166751.861637:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446764800 00000100:00100000:1.0:1762166751.861642:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446764800 00000100:00100000:1.0:1762166751.861667:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 528 00000100:00100000:1.0:1762166751.861674:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:6496:x1847765446764800:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1762166751.861726:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:6496:x1847765446764800:12345-0@lo:1000:mdt00_002.0 Request processed in 52us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166751.861734:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 528 00000100:00100000:2.0:1762166751.861760:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd3800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6496:1847765446764800:0@lo:1000:mdt00_002.0 00000040:00080000:2.0:1762166751.862742:0:6496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x2:0x0].4, 2160 off37440 00000040:00080000:2.0:1762166751.862827:0:6496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x2:0x0].4, 2360 off38016 00000004:00080000:2.0:1762166751.862834:0:6496:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff945bc37313c0 with version 10 00000004:00080000:1.0:1762166751.862896:0:7425:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff945cc6268300 version 10 rpc_version 10 00000020:00100000:1.0:1762166751.862930:0:7425:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1762166751.862939:0:7425:0:(client.c:796:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff945bc5bc3b80 x1847765446765056/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1762166751.862956:0:7425:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc3b80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7425:1847765446765056:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1762166751.862995:0:7425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166751.863021:0:7425:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc3ea6240 going to sleep for 11 seconds 00000100:00100000:0.0:1762166751.863049:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446765056 00000100:00100000:0.0:1762166751.863058:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446765056 00000100:00100000:0.0:1762166751.863097:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 529 00000100:00100000:0.0:1762166751.863104:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:7425:x1847765446765056:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1762166751.863613:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:7425:x1847765446765056:12345-0@lo:1000:osp_up0-1.0 Request processed in 510us (618us total) trans 4294968784 rc 0/0 00000100:00100000:0.0:1762166751.863619:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 529 00000100:00100000:1.0:1762166751.863681:0:7425:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc3b80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7425:1847765446765056:0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1762166751.863907:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb0a48c lrc: 3/0,1 mode: --/PW res: [0x240000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.863919:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb0a48c lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.863929:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb0a48c lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.863952:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0a493 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.863959:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0a493 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.863965:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0a493 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.863989:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc60b0000/0x2f180c4effb0a49a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.863994:0:6496:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc60b0000/0x2f180c4effb0a49a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.864001:0:6496:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc60b0000/0x2f180c4effb0a49a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6496 initiator: MDT1 00000100:00100000:2.0:1762166751.864009:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd3800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6496:1847765446765184:0@lo:101:mdt00_002.0 00000100:00100000:2.0:1762166751.864028:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166751.864045:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc37310c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166751.864113:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446765184 00000100:00100000:0.0:1762166751.864118:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446765184 00000100:00100000:0.0:1762166751.864147:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 530 00000100:00100000:0.0:1762166751.864154:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:6496:x1847765446765184:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1762166751.864167:0:6499:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166751.864181:0:6499:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89400/0x2f180c4effb0a4a1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f180c4effb0a49a expref: -99 pid: 6499 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166751.864199:0:6499:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89400/0x2f180c4effb0a4a1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x2f180c4effb0a49a expref: 10 pid: 6499 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166751.864210:0:6499:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89400/0x2f180c4effb0a4a1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb0a49a expref: 10 pid: 6499 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166751.864218:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff945bc403af00) 00010000:00010000:0.0:1762166751.864221:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166751.864224:0:6499:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bccb89400, rc 0) 00000100:00100000:0.0:1762166751.864261:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:6496:x1847765446765184:12345-0@lo:101:mdt00_002.0 Request processed in 107us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166751.864268:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 530 00000100:00100000:2.0:1762166751.864289:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd3800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6496:1847765446765184:0@lo:101:mdt00_002.0 00010000:00010000:2.0:1762166751.864300:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc60b0000/0x2f180c4effb0a49a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0a4a1 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.864307:0:6496:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc60b0000/0x2f180c4effb0a49a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x2f180c4effb0a4a1 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1762166751.864329:0:6496:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000006c58570 reply state 000000003361b42f transno 4294967345 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0a493 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.864343:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0a493 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.864349:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x4:0x0].0x0 (ffff945bc477fe00) 00010000:00010000:2.0:1762166751.864352:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166751.864355:0:6496:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1762166751.864361:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc60b0000/0x2f180c4effb0a49a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0a4a1 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.864368:0:6496:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc60b0000/0x2f180c4effb0a49a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0a4a1 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1762166751.864376:0:6496:0:(osp_object.c:1389:osp_invalidate()) Invalidate osp_object [0x200000401:0x4:0x0] 00000004:00010000:2.0:1762166751.864382:0:6496:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000006c58570 reply state 000000003361b42f transno 4294967345 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb0a48c lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.864389:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb0a48c lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.864393:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x1:0x0].0x0 (ffff945bc477f400) 00010000:00010000:2.0:1762166751.864394:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166751.864396:0:6496:0:(service.c:177:ptlrpc_save_lock()) nlocks 1 00000004:00200000:2.0:1762166751.864404:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000403:0x1:0x0]: returning size 4096 00000004:00080000:2.0:1762166751.864409:0:6496:0:(osp_object.c:1389:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1762166751.864414:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc60b0200/0x2f180c4effb0a470 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x2f180c4effb0a477 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.864419:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc60b0200/0x2f180c4effb0a470 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x2f180c4effb0a477 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.864423:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc60b0200/0x2f180c4effb0a470 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x2f180c4effb0a477 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.864437:0:6496:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1762166751.864440:0:6496:0:(osp_object.c:1389:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1762166751.864442:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc60b1000/0x2f180c4effb0a47e lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6a87ace7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0a485 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.864446:0:6496:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc60b1000/0x2f180c4effb0a47e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6a87ace7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0a485 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166751.864460:0:10256:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166751.864466:0:10256:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc60b0200/0x2f180c4effb0a470 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x2f180c4effb0a477 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166751.864473:0:10256:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0200 already unused, calling callback (ffffffffc18ef820) 00010000:00010000:1.0:1762166751.864501:0:10256:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc60b0200/0x2f180c4effb0a470 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x2f180c4effb0a477 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1762166751.864507:0:10256:0:(mdt_handler.c:3944:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc60b0200/0x2f180c4effb0a470 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x2f180c4effb0a477 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166751.864524:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+7:36464:x1847765439958016:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 8094us (8225us total) trans 4294967345 rc 0/0 00000100:00100000:2.0:1762166751.864530:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2396 00010000:00010000:1.0:1762166751.864535:0:10256:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc60b0200/0x2f180c4effb0a470 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x2f180c4effb0a477 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166751.864541:0:10256:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1762166751.864560:0:10256:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc60b0200/0x2f180c4effb0a470 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x2f180c4effb0a477 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166751.864565:0:10256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc60b0200/0x2f180c4effb0a470 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x2f180c4effb0a477 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166751.864568:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1762166751.864575:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762166751.864578:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc494c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446765312:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1762166751.864578:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166751.864582:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762166751.864601:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166751.864642:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446765312 00000100:00100000:3.0:1762166751.864648:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446765312 00000100:00100000:3.0:1762166751.864685:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1762166751.864693:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+10:3635:x1847765446765312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1762166751.864704:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166751.864719:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0a477 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x2f180c4effb0a470 expref: 10 pid: 7427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166751.864787:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:3.0:1762166751.864791:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166751.864833:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+9:3635:x1847765446765312:12345-0@lo:103:ldlm_bl.0 Request processed in 141us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166751.864840:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1762166751.864860:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc494c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446765312:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1762166751.870820:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166751.870873:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439958272 00000100:00100000:2.0:1762166751.870883:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439958272 00000100:00100000:2.0:1762166751.870933:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2397 00000100:00100000:2.0:1762166751.870944:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+10:36467:x1847765439958272:12345-192.168.204.38@tcp:101:rm.0 00010000:00010000:2.0:1762166751.870974:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166751.870992:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0a4a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b739f expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.871061:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1600/0x2f180c4effb0a4af lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.871074:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1600/0x2f180c4effb0a4af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.871098:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1600/0x2f180c4effb0a4af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:2.0:1762166751.871139:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1762166751.871142:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166751.871159:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1600/0x2f180c4effb0a4af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.871181:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0a4a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b739f expref: 12 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.871197:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1600/0x2f180c4effb0a4af lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b739f expref: 11 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.871205:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:2.0:1762166751.871207:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1762166751.871211:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b1600, rc 0) 00000100:00100000:2.0:1762166751.871265:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+11:36467:x1847765439958272:12345-192.168.204.38@tcp:101:rm.0 Request processed in 323us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166751.871272:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2397 00000100:00100000:0.0:1762166751.872372:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166751.872409:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439958400 00000100:00100000:2.0:1762166751.872420:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439958400 00000100:00100000:2.0:1762166751.872453:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2398 00000100:00100000:2.0:1762166751.872461:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+11:36467:x1847765439958400:12345-192.168.204.38@tcp:101:rm.0 00010000:00010000:2.0:1762166751.872471:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166751.872513:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0a4b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b73a6 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.872545:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0a4bd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.872552:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0a4bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.872557:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0a4bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.872564:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1400/0x2f180c4effb0a4c4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6a87ace7 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.872570:0:6496:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89c00/0x2f180c4effb0a485 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6a87ace7 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb0a47e expref: 8 pid: 7427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.872575:0:6496:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1400/0x2f180c4effb0a4c4 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6a87ace7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.872597:0:6496:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89c00/0x2f180c4effb0a485 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6a87ace7 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x2f180c4effb0a47e expref: 8 pid: 7427 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166751.872607:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446765440:0@lo:104: 00000100:00100000:2.0:1762166751.872635:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166751.872673:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc3731540 going to sleep for 11 seconds 00000100:00100000:0.0:1762166751.872681:0:6478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446765440 00000100:00100000:0.0:1762166751.872694:0:6478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446765440 00000100:00100000:0.0:1762166751.872726:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1762166751.872734:0:6478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6496:x1847765446765440:12345-0@lo:104: 00010000:00010000:0.0:1762166751.872744:0:6478:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc60b1000/0x2f180c4effb0a47e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6a87ace7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x2f180c4effb0a485 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166751.872804:0:6478:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1762166751.872810:0:6478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6496:x1847765446765440:12345-0@lo:104: Request processed in 78us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166751.872818:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00010000:3.0:1762166751.872835:0:7420:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1762166751.872835:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446765440:0@lo:104: 00010000:00010000:3.0:1762166751.872844:0:7420:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc60b1000/0x2f180c4effb0a47e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6a87ace7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x2f180c4effb0a485 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166751.872856:0:7420:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1000 already unused, calling callback (ffffffffc18ef820) 00010000:00010000:2.0:1762166751.872857:0:6496:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1400/0x2f180c4effb0a4c4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6a87ace7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166751.872870:0:7420:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc60b1000/0x2f180c4effb0a47e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6a87ace7 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x2f180c4effb0a485 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1762166751.872879:0:7420:0:(mdt_handler.c:3944:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc60b1000/0x2f180c4effb0a47e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6a87ace7 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x2f180c4effb0a485 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166751.872903:0:7420:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc60b1000/0x2f180c4effb0a47e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6a87ace7 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x2f180c4effb0a485 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166751.872910:0:7420:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1762166751.872938:0:7420:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc60b1000/0x2f180c4effb0a47e lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6a87ace7 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x2f180c4effb0a485 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166751.872946:0:7420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc60b1000/0x2f180c4effb0a47e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6a87ace7 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x2f180c4effb0a485 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166751.872954:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1e6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446765568:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1762166751.872965:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166751.872968:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166751.872972:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166751.872987:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166751.873026:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446765568 00000100:00100000:3.0:1762166751.873030:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446765568 00010000:00010000:3.0:1762166751.873050:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89c00/0x2f180c4effb0a485 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6a87ace7 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x2f180c4effb0a47e expref: 9 pid: 7427 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166751.873079:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 556 00000100:00100000:3.0:1762166751.873099:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+9:3633:x1847765446765568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1762166751.873110:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:1.0:1762166751.874367:0:6475:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968784 is committed 00000001:00080000:1.0:1762166751.874393:0:6475:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968783 is committed 00000004:00080000:1.0:1762166751.874399:0:6475:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 84 committed 00000004:00080000:1.0:1762166751.874411:0:6475:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 90 committed 00010000:00010000:0.0:1762166751.874517:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0a3eb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x71939024 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166751.874527:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0a3eb lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x71939024 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00000100:00100000:1.0:1762166751.874529:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446765696:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1762166751.874541:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0a3eb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x71939024 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00000100:00100000:3.0:1762166751.874547:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1762166751.874548:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166751.874555:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0a3eb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x71939024 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00000100:00100000:3.0:1762166751.874561:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1e6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446765824:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1762166751.874563:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0a3eb lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x71939024 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166751.874580:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71939024 (ffff945cf39a3f00) 00000100:00100000:1.0:1762166751.874581:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1762166751.874585:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89c00/0x2f180c4effb0a485 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6a87ace7 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x2f180c4effb0a47e expref: 8 pid: 7427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166751.874587:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166751.874593:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0a3eb lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x71939024 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166751.874601:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6a87ace7 (ffff945bc403aa00) 00010000:00010000:2.0:1762166751.874609:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1400/0x2f180c4effb0a4c4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6a87ace7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166751.874613:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0a3eb lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x71939024 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00000100:00100000:3.0:1762166751.874615:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1762166751.874628:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1400/0x2f180c4effb0a4c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6a87ace7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.874634:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1400/0x2f180c4effb0a4c4 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6a87ace7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00000100:00100000:1.0:1762166751.874648:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446765696 00010000:00010000:0.0:1762166751.874648:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1a00/0x2f180c4effb0a438 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdf5e0693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166751.874654:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166751.874655:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446765696 00010000:00010000:0.0:1762166751.874658:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1a00/0x2f180c4effb0a438 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdf5e0693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00000100:00100000:3.0:1762166751.874664:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446765824 00010000:00010000:0.0:1762166751.874666:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1a00/0x2f180c4effb0a438 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdf5e0693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00000100:00100000:3.0:1762166751.874669:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446765824 00010000:00010000:0.0:1762166751.874675:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166751.874679:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1a00/0x2f180c4effb0a438 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdf5e0693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166751.874686:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1a00/0x2f180c4effb0a438 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdf5e0693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00000100:00100000:2.0:1762166751.874693:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+7:3633:x1847765446765568:12345-0@lo:103:ldlm_bl.0 Request processed in 1604us (1703us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166751.874700:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdf5e0693 (ffff945cf39a3700) 00000100:00100000:2.0:1762166751.874706:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 556 00000100:00100000:1.0:1762166751.874706:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 846 00010000:00010000:0.0:1762166751.874708:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166751.874714:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1a00/0x2f180c4effb0a438 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xdf5e0693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00000100:00100000:3.0:1762166751.874722:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 847 00000100:00100000:1.0:1762166751.874725:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1847765446765696:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1762166751.874725:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1a00/0x2f180c4effb0a438 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xdf5e0693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00000100:00100000:3.0:1762166751.874735:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3636:x1847765446765824:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1762166751.874737:0:6496:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1400/0x2f180c4effb0a4c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6a87ace7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.874747:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1400/0x2f180c4effb0a4c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6a87ace7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00002000:00080000:3.0:1762166751.874756:0:9168:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:57 count 1 00002000:00080000:1.0:1762166751.874757:0:8382:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:55 count 1 00000100:00080000:0.0:1762166751.874771:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1762166751.874776:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1762166751.874786:0:9168:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945cf3dc7400/0x2f180c4effb0a4d2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762166751.874789:0:8382:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1762166751.874800:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1e6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446765568:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1762166751.874801:0:8382:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945cf786be00/0x2f180c4effb0a4cb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166751.874810:0:9168:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0a3dd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7375 expref: 5 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166751.874822:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166751.874826:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166751.874830:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cf3dc7400/0x2f180c4effb0a4d2 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166751.874830:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166751.874835:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1762166751.874839:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd3100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6496:1847765446765952:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1762166751.874842:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cf786be00/0x2f180c4effb0a4cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166751.874859:0:8382:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cf786be00/0x2f180c4effb0a4cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166751.874864:0:9168:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0a3dd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000000010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7375 expref: 5 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166751.874872:0:8382:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945cf786be00/0x2f180c4effb0a4cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166751.874875:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1762166751.874887:0:8382:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cf786be00/0x2f180c4effb0a4cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166751.874889:0:9168:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0a3dd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x70000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7375 expref: 5 pid: 28874 timeout: 471 lvb_type: 1 00000100:00100000:2.0:1762166751.874896:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc3731840 going to sleep for 11 seconds 00000100:00100000:3.0:1762166751.874912:0:9168:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1e6c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9168:1847765446766080:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166751.874922:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446765952 00000100:00100000:0.0:1762166751.874928:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446765952 00010000:00010000:1.0:1762166751.874934:0:8382:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166751.874951:0:6482:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166751.874959:0:6482:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cf786be00/0x2f180c4effb0a4cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166751.874968:0:9168:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cd1ae6c00 going to sleep for 11 seconds 00000100:00100000:0.0:1762166751.874975:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 531 00010000:00010000:2.0:1762166751.874979:0:6482:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786be00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166751.874985:0:6482:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cf786be00/0x2f180c4effb0a4cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166751.874987:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6496:x1847765446765952:12345-0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1762166751.874994:0:6482:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cf786be00/0x2f180c4effb0a4cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.875005:0:6482:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cf786be00/0x2f180c4effb0a4cb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.875009:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cf786be00/0x2f180c4effb0a4cb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.875023:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166751.875025:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166751.875026:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166751.875069:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6496:x1847765446765952:12345-0@lo:1000:mdt00_002.0 Request processed in 85us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166751.875071:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd3100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6496:1847765446765952:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1762166751.875083:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 531 00010000:00010000:2.0:1762166751.875127:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0a4d9 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.875135:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0a4d9 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.875141:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0a4d9 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00010000:2.0:1762166751.875153:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0a4d9 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000100:00100000:1.0:1762166751.875159:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3634:x1847765446765696:12345-0@lo:6:osp-syn-1-0.0 Request processed in 442us (579us total) trans 17179869309 rc 0/0 00000100:00100000:1.0:1762166751.875174:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 846 00010000:00010000:2.0:1762166751.875179:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0a4bd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.875184:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0a4bd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.875188:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0a4bd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00000100:00100000:0.0:1762166751.875190:0:3634:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179869308 gen 2 00010000:00010000:2.0:1762166751.875192:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0a4bd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.875198:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0200 already unused, calling callback (ffffffffc18e2310) 00000004:00080000:0.0:1762166751.875198:0:3634:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bcbe35f80, transno 17179869299 00010000:00010000:2.0:1762166751.875202:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0a4bd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.875207:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0a4bd lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.875212:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:2.0:1762166751.875214:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000004:00080000:0.0:1762166751.875216:0:3634:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bcbe36300, transno 17179869300 00010000:00010000:2.0:1762166751.875217:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0a4bd lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.875223:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0a4bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00000004:00080000:0.0:1762166751.875225:0:3634:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bcbe37b80, transno 17179869301 00010000:00010000:2.0:1762166751.875231:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1400/0x2f180c4effb0a4c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6a87ace7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00000004:00080000:0.0:1762166751.875232:0:3634:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4530000, transno 17179869302 00000004:00080000:0.0:1762166751.875238:0:3634:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4530700, transno 17179869303 00010000:00010000:2.0:1762166751.875240:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1400/0x2f180c4effb0a4c4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6a87ace7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00000004:00080000:0.0:1762166751.875244:0:3634:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4533b80, transno 17179869304 00010000:00010000:2.0:1762166751.875246:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1400/0x2f180c4effb0a4c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6a87ace7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00000004:00080000:0.0:1762166751.875250:0:3634:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945d011e9180, transno 17179869306 00000004:00080000:0.0:1762166751.875257:0:3634:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945d011e9880, transno 17179869307 00010000:00010000:2.0:1762166751.875258:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166751.875263:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1400/0x2f180c4effb0a4c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6a87ace7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00000004:00080000:0.0:1762166751.875263:0:3634:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945d011e8000, transno 17179869308 00010000:00010000:2.0:1762166751.875271:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1400/0x2f180c4effb0a4c4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6a87ace7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00000100:00100000:0.0:1762166751.875276:0:3634:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff945cf1cd2d80 x1847765446765696/t17179869309(17179869309) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1762166767 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1762166751.875278:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6a87ace7 (ffff945bc403aa00) 00010000:00010000:2.0:1762166751.875281:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166751.875284:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1400/0x2f180c4effb0a4c4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6a87ace7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.875294:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1400/0x2f180c4effb0a4c4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6a87ace7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00000004:00080000:0.0:1762166751.875300:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf1cd2d80/2, rc 0, transno 17179869309 00000100:00100000:0.0:1762166751.875308:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446765696:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1762166751.875336:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0a4b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b73a6 expref: 8 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.875353:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0a4d9 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b73a6 expref: 7 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.875360:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x1:0x0].0x0 (ffff945bc477f700) 00010000:00010000:2.0:1762166751.875363:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1762166751.875365:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0c00, rc 0) 00000004:00080000:3.0:1762166751.875374:0:10004:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 1 changes, 1 in progress, 0 in flight, 7 done 00000100:00100000:2.0:1762166751.875401:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+7:36467:x1847765439958400:12345-192.168.204.38@tcp:101:rm.0 Request processed in 2940us (3029us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166751.875408:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2398 00000100:00100000:3.0:1762166751.875990:0:9168:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1e6c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9168:1847765446766080:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166751.876003:0:9168:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945cf3dc7400/0x2f180c4effb0a4d2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166751.876162:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166751.876199:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439958528 00000100:00100000:2.0:1762166751.876204:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439958528 00010000:00010000:2.0:1762166751.876223:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0a3dd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7375 expref: 6 pid: 28874 timeout: 471 lvb_type: 1 00000100:00100000:2.0:1762166751.876260:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 557 00000100:00100000:2.0:1762166751.876268:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+6:2418:x1847765439958528:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166751.876278:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166751.876284:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0a3dd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7375 expref: 6 pid: 28874 timeout: 471 lvb_type: 1 00010000:00010000:2.0:1762166751.876296:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0a3dd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7375 expref: 6 pid: 28874 timeout: 471 lvb_type: 1 00010000:00010000:2.0:1762166751.876311:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0a3dd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x44801400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7375 expref: 6 pid: 28874 timeout: 471 lvb_type: 1 00010000:00010000:2.0:1762166751.876322:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166751.876323:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166751.876327:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945cf3dc7400/0x2f180c4effb0a4d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.876335:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cf3dc7400/0x2f180c4effb0a4d2 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.876357:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166751.876388:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+5:2418:x1847765439958528:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 121us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166751.876396:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 557 00010000:00010000:3.0:1762166751.876428:0:9168:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945cf3dc7400/0x2f180c4effb0a4d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166751.876436:0:9168:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cf3dc7400/0x2f180c4effb0a4d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166751.876442:0:9168:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945cf3dc7400/0x2f180c4effb0a4d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166751.876446:0:9168:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945cf3dc7400/0x2f180c4effb0a4d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166751.876460:0:9168:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166751.876500:0:6483:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166751.876505:0:6483:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945cf3dc7400/0x2f180c4effb0a4d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166751.876510:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:2.0:1762166751.876519:0:6483:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3dc7400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166751.876522:0:6483:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945cf3dc7400/0x2f180c4effb0a4d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.876528:0:6483:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945cf3dc7400/0x2f180c4effb0a4d2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.876539:0:6483:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945cf3dc7400/0x2f180c4effb0a4d2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.876543:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cf3dc7400/0x2f180c4effb0a4d2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166751.876552:0:7438:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439958656 00010000:00010000:2.0:1762166751.876555:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166751.876558:0:7438:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439958656 00010000:00010000:2.0:1762166751.876559:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166751.876563:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166751.876604:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 10 00000100:00100000:0.0:1762166751.876616:0:7438:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0002:c5f20b66-016a-4159-9d62-071c0da3ef0b+7:36467:x1847765439958656:12345-192.168.204.38@tcp:900:rm.0 00000100:00100000:3.0:1762166751.876659:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3636:x1847765446765824:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1929us (2047us total) trans 21474836620 rc 0/0 00000100:00100000:3.0:1762166751.876665:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 847 00000100:00100000:0.0:1762166751.876675:0:7438:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0002:c5f20b66-016a-4159-9d62-071c0da3ef0b+7:36467:x1847765439958656:12345-192.168.204.38@tcp:900:rm.0 Request processed in 61us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166751.876677:0:3636:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836619 gen 2 00000004:00080000:2.0:1762166751.876683:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945ceffd3100, transno 21474836613 00000100:00100000:0.0:1762166751.876689:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 10 00000004:00080000:2.0:1762166751.876697:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945ceffd2a00, transno 21474836614 00000004:00080000:2.0:1762166751.876704:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc55dce00, transno 21474836615 00000004:00080000:2.0:1762166751.876709:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc55dc700, transno 21474836616 00000004:00080000:2.0:1762166751.876713:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc55ddc00, transno 21474836617 00000004:00080000:2.0:1762166751.876718:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945ceffd1f80, transno 21474836618 00000004:00080000:2.0:1762166751.876722:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945ceffd2d80, transno 21474836619 00000100:00100000:2.0:1762166751.876728:0:3636:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff945cf1e6c380 x1847765446765824/t21474836620(21474836620) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1762166767 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1762166751.876746:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf1e6c380/2, rc 0, transno 21474836620 00000100:00100000:2.0:1762166751.876761:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1e6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446765824:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1762166751.876857:0:9163:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 2 changes, 1 in progress, 0 in flight, 5 done 00000100:00100000:1.0:1762166751.877741:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166751.877782:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439958784 00000100:00100000:2.0:1762166751.877786:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439958784 00000100:00100000:2.0:1762166751.877823:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2399 00000100:00100000:2.0:1762166751.877834:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+7:36467:x1847765439958784:12345-192.168.204.38@tcp:101:rm.0 00010000:00010000:2.0:1762166751.877844:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166751.877857:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb0a4e0 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b73ad expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.877906:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1a00/0x2f180c4effb0a4e7 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.877917:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1a00/0x2f180c4effb0a4e7 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.877925:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1a00/0x2f180c4effb0a4e7 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000004:00200000:2.0:1762166751.877994:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000403:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1762166751.877998:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1762166751.878020:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb0a4e0 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b73ad expref: 9 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.878030:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1a00/0x2f180c4effb0a4e7 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b73ad expref: 8 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.878034:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x1:0x0].0x0 (ffff945bc477f400) 00010000:00010000:2.0:1762166751.878036:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:2.0:1762166751.878038:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b1a00, rc 0) 00000100:00100000:2.0:1762166751.878066:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+8:36467:x1847765439958784:12345-192.168.204.38@tcp:101:rm.0 Request processed in 235us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166751.878079:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2399 00000100:00100000:1.0:1762166751.879035:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166751.879072:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439958912 00000100:00100000:2.0:1762166751.879077:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439958912 00000100:00100000:2.0:1762166751.879117:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2400 00000100:00100000:2.0:1762166751.879125:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+8:36467:x1847765439958912:12345-192.168.204.38@tcp:101:rm.0 00010000:00010000:2.0:1762166751.879134:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166751.879143:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0a4ee lrc: 2/0,0 mode: --/CR res: [0x240000400:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b73b4 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.879175:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0a4f5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.879184:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0a4f5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.879192:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0a4f5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000004:00200000:2.0:1762166751.879213:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000400:0x4:0x0]: returning size 4096 00000004:00200000:2.0:1762166751.879216:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1762166751.879234:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0a4ee lrc: 0/0,0 mode: --/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b73b4 expref: 10 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.879246:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0a4f5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b73b4 expref: 9 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.879253:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x4:0x0].0x0 (ffff945bc477fe00) 00010000:00010000:2.0:1762166751.879255:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1762166751.879257:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc29cba00, rc 0) 00000100:00100000:2.0:1762166751.879294:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+9:36467:x1847765439958912:12345-192.168.204.38@tcp:101:rm.0 Request processed in 170us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166751.879301:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2400 00000100:00100000:3.0:1762166751.880223:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166751.880259:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439959040 00000100:00100000:2.0:1762166751.880263:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439959040 00000100:00100000:2.0:1762166751.880287:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2401 00000100:00100000:2.0:1762166751.880292:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+7:36467:x1847765439959040:12345-192.168.204.38@tcp:101:rm.0 00010000:00010000:2.0:1762166751.880299:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166751.880308:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0a4fc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b73bb expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.880342:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca000/0x2f180c4effb0a503 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.880352:0:6496:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89400/0x2f180c4effb0a4a1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb0a49a expref: 6 pid: 6499 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.880360:0:6496:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca000/0x2f180c4effb0a503 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.880383:0:6496:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89400/0x2f180c4effb0a4a1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x2f180c4effb0a49a expref: 6 pid: 6499 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166751.880394:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bba680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446766208:0@lo:104: 00000100:00100000:2.0:1762166751.880419:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166751.880446:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc3731540 going to sleep for 11 seconds 00000100:00100000:0.0:1762166751.880462:0:6478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446766208 00000100:00100000:0.0:1762166751.880468:0:6478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446766208 00000100:00100000:0.0:1762166751.880534:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1762166751.880541:0:6478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bbb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6496:x1847765446766208:12345-0@lo:104: 00010000:00010000:0.0:1762166751.880550:0:6478:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc60b0000/0x2f180c4effb0a49a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x2f180c4effb0a4a1 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166751.880588:0:6478:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1762166751.880593:0:6478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bbb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6496:x1847765446766208:12345-0@lo:104: Request processed in 53us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166751.880598:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1762166751.880602:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bba680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446766208:0@lo:104: 00010000:00010000:1.0:1762166751.880606:0:10257:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166751.880612:0:10257:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc60b0000/0x2f180c4effb0a49a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x2f180c4effb0a4a1 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.880617:0:6496:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca000/0x2f180c4effb0a503 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166751.880621:0:10257:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0000 already unused, calling callback (ffffffffc18ef820) 00010000:00010000:1.0:1762166751.880627:0:10257:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc60b0000/0x2f180c4effb0a49a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x2f180c4effb0a4a1 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1762166751.880653:0:10257:0:(mdt_handler.c:3944:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc60b0000/0x2f180c4effb0a49a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x2f180c4effb0a4a1 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166751.880672:0:10257:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc60b0000/0x2f180c4effb0a49a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x2f180c4effb0a4a1 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166751.880676:0:10257:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1762166751.880695:0:10257:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc60b0000/0x2f180c4effb0a49a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x2f180c4effb0a4a1 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166751.880701:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc494d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446766336:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1762166751.880702:0:10257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc60b0000/0x2f180c4effb0a49a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x2f180c4effb0a4a1 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166751.880718:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166751.880720:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166751.880722:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762166751.880728:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166751.880758:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446766336 00000100:00100000:3.0:1762166751.880764:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446766336 00010000:00010000:3.0:1762166751.880783:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89400/0x2f180c4effb0a4a1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x2f180c4effb0a49a expref: 7 pid: 6499 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166751.880809:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 558 00000100:00100000:3.0:1762166751.880818:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+7:3636:x1847765446766336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1762166751.880834:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166751.881675:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89400/0x2f180c4effb0a4a1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x2f180c4effb0a49a expref: 7 pid: 6499 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166751.881685:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff945bc403af00) 00010000:00010000:3.0:1762166751.881687:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca000/0x2f180c4effb0a503 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166751.881693:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca000/0x2f180c4effb0a503 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166751.881697:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca000/0x2f180c4effb0a503 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166751.881713:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166751.881727:0:6496:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca000/0x2f180c4effb0a503 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.881740:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca000/0x2f180c4effb0a503 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000100:00100000:3.0:1762166751.881747:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+6:3636:x1847765446766336:12345-0@lo:103:ldlm_bl.0 Request processed in 930us (1017us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166751.881755:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 558 00000004:00200000:2.0:1762166751.881773:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 4096 00000004:00200000:2.0:1762166751.881778:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000100:00100000:0.0:1762166751.881785:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc494d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446766336:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1762166751.881807:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0a4fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b73bb expref: 9 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.881822:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca000/0x2f180c4effb0a503 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b73bb expref: 8 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.881828:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff945bc403af00) 00010000:00010000:2.0:1762166751.881831:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1762166751.881833:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc29ca000, rc 0) 00000100:00100000:2.0:1762166751.881864:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+8:36467:x1847765439959040:12345-192.168.204.38@tcp:101:rm.0 Request processed in 1572us (1643us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166751.881869:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2401 00000100:00100000:1.0:1762166751.883112:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166751.883147:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439959168 00000100:00100000:2.0:1762166751.883154:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439959168 00000100:00100000:2.0:1762166751.883190:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2402 00000100:00100000:2.0:1762166751.883200:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+9:36467:x1847765439959168:12345-192.168.204.38@tcp:101:rm.0 00010000:00010000:2.0:1762166751.883213:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166751.883231:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb000/0x2f180c4effb0a50a lrc: 2/0,0 mode: --/CR res: [0x240000400:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b73c2 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.883274:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb800/0x2f180c4effb0a511 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.883283:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb800/0x2f180c4effb0a511 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.883290:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb800/0x2f180c4effb0a511 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.883302:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb0a518 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.883309:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb0a518 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.883327:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb0a518 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.883373:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb800/0x2f180c4effb0a511 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.883380:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb800/0x2f180c4effb0a511 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.883386:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb800/0x2f180c4effb0a511 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.883393:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb800/0x2f180c4effb0a511 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.883398:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29cb800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166751.883401:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb800/0x2f180c4effb0a511 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.883412:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb800/0x2f180c4effb0a511 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.883419:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x4:0x0].0x0 (ffff945bc477fe00) 00010000:00010000:2.0:1762166751.883422:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166751.883425:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb800/0x2f180c4effb0a511 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.883431:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb800/0x2f180c4effb0a511 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.883440:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb0a518 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.883445:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb0a518 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.883450:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb0a518 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.883455:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29ca600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166751.883457:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb0a518 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.883463:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb0a518 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.883470:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x4:0x0].0x8f0a8bfd (ffff945bc477fb00) 00010000:00010000:2.0:1762166751.883472:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166751.883505:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb0a518 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.883512:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb0a518 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.883540:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb000/0x2f180c4effb0a50a lrc: 1/0,0 mode: --/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b73c2 expref: 10 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.883549:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x4:0x0].0x0 (ffff945bc477fe00) 00010000:00010000:2.0:1762166751.883552:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166751.883555:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb000/0x2f180c4effb0a50a lrc: 0/0,0 mode: --/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b73c2 expref: 10 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.883563:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc29cb000, rc 0) 00000100:00100000:2.0:1762166751.883596:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+9:36467:x1847765439959168:12345-192.168.204.38@tcp:101:rm.0 Request processed in 398us (484us total) trans 0 rc 301/301 00000100:00100000:2.0:1762166751.883604:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2402 00000100:00100000:1.0:1762166751.896173:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166751.896235:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439959296 00000100:00100000:2.0:1762166751.896247:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439959296 00000100:00100000:2.0:1762166751.896303:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2403 00000100:00100000:2.0:1762166751.896314:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+9:36470:x1847765439959296:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166751.896336:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166751.896359:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb000/0x2f180c4effb0a51f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b73c9 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.896427:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb0a526 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.896441:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb0a526 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.896452:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb0a526 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000004:00200000:2.0:1762166751.896577:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000403:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1762166751.896582:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:2.0:1762166751.896600:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb0a526 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.896626:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb000/0x2f180c4effb0a51f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b73c9 expref: 11 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.896646:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb0a526 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b73c9 expref: 10 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.896655:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x1:0x0].0x0 (ffff945bc477f400) 00010000:00010000:2.0:1762166751.896658:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1762166751.896662:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc29ca600, rc 0) 00000100:00100000:2.0:1762166751.896738:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+10:36470:x1847765439959296:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 425us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166751.896746:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2403 00000100:00100000:3.0:1762166751.899618:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166751.899684:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439959552 00000100:00100000:2.0:1762166751.899699:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439959552 00000100:00100000:2.0:1762166751.899774:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2404 00000100:00100000:2.0:1762166751.899786:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+10:36470:x1847765439959552:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166751.899807:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166751.899811:0:6496:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1762166751.899838:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0a4f5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b73b4 expref: 10 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.899859:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x4:0x0].0x0 (ffff945bc477fe00) 00010000:00010000:2.0:1762166751.899876:0:6496:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166751.899890:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb800/0x2f180c4effb0a52d lrc: 2/0,0 mode: --/CW res: [0x240000400:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b73d0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.899982:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0a534 lrc: 3/0,1 mode: --/CW res: [0x240000400:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.899994:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0a534 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.900003:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0a534 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.900017:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb0a53b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.900024:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb0a53b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.900030:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb0a53b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000100:00100000:2.0:1762166751.900170:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bbb480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6496:1847765446766464:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1762166751.900238:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166751.900303:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc3731840 going to sleep for 11 seconds 00000100:00100000:0.0:1762166751.900307:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446766464 00000100:00100000:0.0:1762166751.900322:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446766464 00000100:00100000:0.0:1762166751.900368:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 532 00000100:00100000:0.0:1762166751.900377:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:6496:x1847765446766464:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1762166751.900444:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:6496:x1847765446766464:12345-0@lo:1000:mdt00_002.0 Request processed in 69us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166751.900451:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 532 00000100:00100000:2.0:1762166751.900503:0:6496:0:(client.c:3071:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294968784 gen 2 00000004:00080000:2.0:1762166751.900509:0:6496:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294968784 committed transno 4294968784 00000100:00100000:2.0:1762166751.900538:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bbb480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6496:1847765446766464:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1762166751.900909:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0a542 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.900919:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0a542 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.900933:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0a542 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000004:00200000:2.0:1762166751.900944:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000403:0x2:0x0]: returning size 0 00010000:00010000:2.0:1762166751.900969:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0a534 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.900976:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0a534 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.900982:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0a534 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.900989:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0a534 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.900995:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29cb600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166751.900999:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0a534 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.901006:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0a534 lrc: 5/0,0 mode: CW/CW res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.901015:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x4:0x0].0x0 (ffff945bc477fe00) 00010000:00010000:2.0:1762166751.901018:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166751.901022:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0a534 lrc: 3/0,0 mode: --/CW res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.901028:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0a534 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00000004:00010000:2.0:1762166751.901039:0:6496:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000b424be0f reply state 000000008ebd82fe transno 4294967346 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb0a53b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.901060:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb0a53b lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.901067:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x4:0x0].0x8f0a8bfd (ffff945bc477f600) 00010000:00010000:2.0:1762166751.901070:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166751.901072:0:6496:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1762166751.901111:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb800/0x2f180c4effb0a52d lrc: 0/0,0 mode: --/CW res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b73d0 expref: 12 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.901125:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0a542 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b73d0 expref: 11 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.901133:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2:0x0].0x0 (ffff945bc477f100) 00010000:00010000:2.0:1762166751.901135:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166751.901138:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0a00, rc 0) 00000100:00100000:2.0:1762166751.901186:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+12:36470:x1847765439959552:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1403us (1579us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1762166751.901193:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2404 00000100:00100000:1.0:1762166751.903433:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166751.903543:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439959808 00000100:00100000:2.0:1762166751.903556:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439959808 00000100:00100000:2.0:1762166751.903605:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2405 00000100:00100000:2.0:1762166751.903615:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+12:36470:x1847765439959808:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166751.903635:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166751.903651:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0a550 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b73d7 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.903743:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb0a557 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.903769:0:6496:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0a542 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b73d0 expref: 13 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.903777:0:6496:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb0a557 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.903812:0:6496:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0a542 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b73d0 expref: 13 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.903826:0:6496:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0a542 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b73d0 expref: 13 pid: 6496 timeout: 471 lvb_type: 0 00000100:00100000:2.0:1762166751.903841:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bbb480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6496:1847765446766592:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166751.903937:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc3731a80 going to sleep for 11 seconds 00000100:00100000:2.0:1762166751.904914:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bbb480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6496:1847765446766592:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166751.904941:0:6496:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb0a557 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000100:00100000:1.0:1762166751.905112:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166751.905216:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439959936 00000100:00100000:3.0:1762166751.905224:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439959936 00010000:00010000:3.0:1762166751.905251:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0a542 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b73d0 expref: 14 pid: 6496 timeout: 471 lvb_type: 0 00000100:00100000:3.0:1762166751.905283:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 559 00000100:00100000:3.0:1762166751.905293:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+14:2418:x1847765439959936:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166751.905305:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166751.905311:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0a542 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b73d0 expref: 14 pid: 6496 timeout: 471 lvb_type: 0 00010000:00010000:3.0:1762166751.905337:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0a542 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b73d0 expref: 14 pid: 6496 timeout: 471 lvb_type: 0 00010000:00010000:3.0:1762166751.905357:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0a542 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b73d0 expref: 14 pid: 6496 timeout: 471 lvb_type: 0 00010000:00010000:3.0:1762166751.905371:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2:0x0].0x0 (ffff945bc477f100) 00010000:00010000:3.0:1762166751.905376:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb0a557 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166751.905383:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb0a557 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166751.905389:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb0a557 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166751.905411:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166751.905427:0:6496:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb0a557 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.905433:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb0a557 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000004:00200000:2.0:1762166751.905450:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000403:0x2:0x0]: returning size 0 00000100:00100000:3.0:1762166751.905451:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+13:2418:x1847765439959936:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 160us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166751.905462:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 559 00000004:00080000:2.0:1762166751.905650:0:6496:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x11:0x0], index 0: 0 00000004:00080000:2.0:1762166751.905660:0:6496:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x11:0x0], index 1: 0 00000004:00080000:2.0:1762166751.905665:0:6496:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x12:0x0], index 0: 0 00000100:00100000:0.0:1762166751.905672:0:9159:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945d011e9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:9159:1847765446766848:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1762166751.905680:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945d011e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446766720:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1762166751.905720:0:9159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166751.905725:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166751.905757:0:9159:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ceffd4780 going to sleep for 11 seconds 00000100:00100000:1.0:1762166751.905769:0:8385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446766720 00010000:00010000:2.0:1762166751.905770:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb0a557 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00000100:00100000:3.0:1762166751.905772:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446766848 00000100:00100000:1.0:1762166751.905775:0:8385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446766720 00000100:00100000:3.0:1762166751.905781:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446766848 00010000:00010000:2.0:1762166751.905784:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb0a557 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.905792:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb0a557 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.905798:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166751.905803:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb0a557 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.905811:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb0a557 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00000100:00080000:0.0:1762166751.905811:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1762166751.905822:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2:0x0].0x0 (ffff945bc477f100) 00010000:00010000:2.0:1762166751.905826:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1762166751.905827:0:8385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00010000:00010000:2.0:1762166751.905831:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb0a557 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00000100:00100000:3.0:1762166751.905836:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 848 00000100:00100000:1.0:1762166751.905836:0:8385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3633:x1847765446766720:12345-0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1762166751.905839:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb0a557 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00000100:00100000:3.0:1762166751.905856:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:9159:x1847765446766848:12345-0@lo:5:osp-pre-0-1.0 00002000:00000024:1.0:1762166751.905867:0:8385:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3922436096 avail 3690913792 00010000:00010000:2.0:1762166751.905886:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0a550 lrc: 1/0,0 mode: --/CR res: [0x240000403:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b73d7 expref: 13 pid: 6496 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1762166751.905894:0:9168:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:2.0:1762166751.905896:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2:0x0].0x0 (ffff945bc477f100) 00010000:00010000:2.0:1762166751.905901:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1762166751.905905:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0a550 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b73d7 expref: 13 pid: 6496 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166751.905911:0:8385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3633:x1847765446766720:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (189us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166751.905921:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0000, rc 0) 00000100:00100000:1.0:1762166751.905924:0:8385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1762166751.905951:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945d011e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446766720:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1762166751.905962:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+12:36470:x1847765439959808:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2348us (2544us total) trans 4294967347 rc 301/301 00000100:00100000:2.0:1762166751.905976:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2405 00000100:00100000:1.0:1762166751.907182:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166751.907221:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439960192 00000100:00100000:2.0:1762166751.907227:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439960192 00000100:00100000:2.0:1762166751.907259:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 692 00000100:00100000:2.0:1762166751.907266:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+12:36470:x1847765439960192:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1762166751.907471:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+13:36470:x1847765439960192:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 203us (289us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1762166751.907503:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 692 00000100:00100000:1.0:1762166751.908523:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166751.908557:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439960448 00000100:00100000:2.0:1762166751.908563:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439960448 00000100:00100000:2.0:1762166751.908594:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 693 00000100:00100000:2.0:1762166751.908600:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7d2b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+13:36470:x1847765439960448:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1762166751.908699:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7d2b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+14:36470:x1847765439960448:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 98us (177us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1762166751.908711:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 693 00000100:00100000:3.0:1762166751.912239:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:9159:x1847765446766848:12345-0@lo:5:osp-pre-0-1.0 Request processed in 6384us (6512us total) trans 21474836621 rc 0/0 00000100:00100000:3.0:1762166751.912251:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 848 00000100:00100000:0.0:1762166751.912278:0:9159:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945d011e9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:9159:1847765446766848:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1762166751.912293:0:9159:0:(osp_precreate.c:701:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x12:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:1.0:1762166751.920931:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166751.920993:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439960704 00000100:00100000:2.0:1762166751.921004:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439960704 00000100:00100000:2.0:1762166751.921048:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2406 00000100:00100000:2.0:1762166751.921055:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+14:36472:x1847765439960704:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166751.921076:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166751.921104:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0a565 lrc: 2/0,0 mode: --/CR res: [0x240000400:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b73de expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.921164:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb0a56c lrc: 3/1,0 mode: --/CR res: [0x240000400:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.921188:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb0a56c lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.921196:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb0a56c lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.921203:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb0a573 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.921207:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb0a573 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.921210:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb0a573 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.921266:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb0a56c lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.921270:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb0a56c lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.921274:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb0a56c lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.921278:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb0a56c lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.921282:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166751.921285:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb0a56c lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.921288:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb0a56c lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.921302:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x4:0x0].0x0 (ffff945bc477fe00) 00010000:00010000:2.0:1762166751.921305:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166751.921309:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb0a56c lrc: 3/0,0 mode: --/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.921313:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb0a56c lrc: 0/0,0 mode: --/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.921337:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb0a573 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.921343:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb0a573 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.921348:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb0a573 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.921353:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166751.921356:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb0a573 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.921362:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb0a573 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.921369:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x4:0x0].0x8f0a8bfd (ffff945bc477f600) 00010000:00010000:2.0:1762166751.921372:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166751.921375:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb0a573 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.921380:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb0a573 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.921420:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0a565 lrc: 1/0,0 mode: --/CR res: [0x240000400:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b73de expref: 15 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.921444:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x4:0x0].0x0 (ffff945bc477fe00) 00010000:00010000:2.0:1762166751.921446:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1762166751.921450:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0a565 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b73de expref: 15 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.921459:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0000, rc 0) 00000100:00100000:2.0:1762166751.921548:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+14:36472:x1847765439960704:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 491us (627us total) trans 0 rc 301/301 00000100:00100000:2.0:1762166751.921557:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2406 00000100:00100000:1.0:1762166751.923161:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166751.923203:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439960960 00000100:00100000:2.0:1762166751.923210:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439960960 00000100:00100000:2.0:1762166751.923241:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2407 00000100:00100000:2.0:1762166751.923247:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+14:36472:x1847765439960960:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166751.923258:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166751.923272:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1200/0x2f180c4effb0a57a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b73e5 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1762166751.923384:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000403:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1762166751.923468:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1200/0x2f180c4effb0a57a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b73e5 expref: 16 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.923501:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc477f100) 00010000:00010000:2.0:1762166751.923504:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1762166751.923509:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1200/0x2f180c4effb0a57a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b73e5 expref: 16 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.923524:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b1200, rc 0) 00000100:00100000:2.0:1762166751.923574:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+15:36472:x1847765439960960:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 327us (416us total) trans 4294967350 rc 301/301 00000100:00100000:2.0:1762166751.923582:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2407 00000100:00100000:1.0:1762166751.925384:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166751.925430:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439961088 00000100:00100000:2.0:1762166751.925441:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439961088 00000100:00100000:2.0:1762166751.925506:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2408 00000100:00100000:2.0:1762166751.925515:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+15:36472:x1847765439961088:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:2.0:1762166751.925572:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0a588 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.925587:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0a588 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.925598:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0a588 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.925606:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb0a58f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.925613:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb0a58f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.925619:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb0a58f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.925676:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0a596 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.925681:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0a596 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.925686:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0a596 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000004:00200000:2.0:1762166751.925721:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000403:0x2:0x0]: returning size 0 00000004:00200000:2.0:1762166751.925724:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166751.925731:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0a596 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.925741:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0a588 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.925745:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0a588 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.925749:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0a588 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.925752:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0a588 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.925756:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166751.925759:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0a588 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.925763:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0a588 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.925769:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x4:0x0].0x0 (ffff945bc477fe00) 00010000:00010000:2.0:1762166751.925772:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166751.925776:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0a588 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.925786:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0a588 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.925796:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb0a58f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.925821:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb0a58f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.925826:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb0a58f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.925830:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166751.925834:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb0a58f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.925839:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb0a58f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.925846:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x4:0x0].0x8f0a8bfd (ffff945bc477f600) 00010000:00010000:2.0:1762166751.925849:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166751.925852:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb0a58f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.925857:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb0a58f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.925865:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0a596 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.925870:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0a596 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.925874:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0a596 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.925878:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166751.925881:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0a596 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.925895:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0a596 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.925901:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2:0x0].0x0 (ffff945bc477fb00) 00010000:00010000:2.0:1762166751.925903:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166751.925905:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0a596 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.925910:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0a596 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00000100:00100000:2.0:1762166751.925970:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+15:36472:x1847765439961088:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 455us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166751.925978:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2408 00000100:00100000:1.0:1762166751.927647:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166751.927692:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439961344 00000100:00100000:2.0:1762166751.927697:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439961344 00000100:00100000:2.0:1762166751.927725:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 694 00000100:00100000:2.0:1762166751.927731:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+15:36472:x1847765439961344:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1762166751.927861:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+16:36472:x1847765439961344:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 130us (216us total) trans 4294967351 rc 0/0 00000100:00100000:2.0:1762166751.927866:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 694 00000100:00100000:1.0:1762166751.934579:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166751.934621:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439961600 00000100:00100000:2.0:1762166751.934632:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439961600 00000100:00100000:2.0:1762166751.934686:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2409 00000100:00100000:2.0:1762166751.934697:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+16:36474:x1847765439961600:12345-192.168.204.38@tcp:101:dd.0 00010000:00010000:2.0:1762166751.934722:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166751.934740:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0a59d lrc: 2/0,0 mode: --/CW res: [0x240000400:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b73ec expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.934877:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb0a5a4 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.934890:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb0a5a4 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.934898:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb0a5a4 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.934905:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0a5ab lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.934910:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0a5ab lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.934913:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0a5ab lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.934967:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1200/0x2f180c4effb0a5b2 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.934975:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1200/0x2f180c4effb0a5b2 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.934981:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1200/0x2f180c4effb0a5b2 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000004:00200000:2.0:1762166751.934991:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000403:0x2:0x0]: returning size 0 00010000:00010000:2.0:1762166751.935070:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb0a5a4 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.935077:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb0a5a4 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.935109:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb0a5a4 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.935115:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb0a5a4 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.935121:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166751.935125:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb0a5a4 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.935132:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb0a5a4 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.935144:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x4:0x0].0x0 (ffff945bc477fe00) 00010000:00010000:2.0:1762166751.935147:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166751.935152:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb0a5a4 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.935158:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb0a5a4 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.935170:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0a5ab lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.935176:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0a5ab lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.935181:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0a5ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.935186:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166751.935189:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0a5ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.935205:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0a5ab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.935213:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x4:0x0].0x8f0a8bfd (ffff945bc477f600) 00010000:00010000:2.0:1762166751.935216:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166751.935218:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0a5ab lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.935224:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0a5ab lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.935274:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0a59d lrc: 0/0,0 mode: --/CW res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b73ec expref: 19 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.935288:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1200/0x2f180c4effb0a5b2 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b73ec expref: 18 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.935295:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2:0x0].0x0 (ffff945bc477fb00) 00010000:00010000:2.0:1762166751.935297:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166751.935299:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b1200, rc 0) 00000100:00100000:2.0:1762166751.935370:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+18:36474:x1847765439961600:12345-192.168.204.38@tcp:101:dd.0 Request processed in 674us (798us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1762166751.935377:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2409 00000100:00100000:1.0:1762166751.936769:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166751.936811:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439961728 00000100:00100000:2.0:1762166751.936818:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439961728 00000100:00100000:2.0:1762166751.936859:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2410 00000100:00100000:2.0:1762166751.936868:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+18:36474:x1847765439961728:12345-192.168.204.38@tcp:101:dd.0 00010000:00010000:2.0:1762166751.936883:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166751.936903:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0a5c0 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b73f3 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.936927:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb0a5c7 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.936936:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb0a5c7 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.936944:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb0a5c7 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.937021:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0a5c0 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b73f3 expref: 20 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.937036:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb0a5c7 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b73f3 expref: 19 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.937043:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2:0x0].0x0 (ffff945bc477fb00) 00010000:00010000:2.0:1762166751.937045:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1762166751.937048:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b1000, rc 0) 00000100:00100000:2.0:1762166751.937112:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+19:36474:x1847765439961728:12345-192.168.204.38@tcp:101:dd.0 Request processed in 245us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166751.937120:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2410 00000100:00100000:1.0:1762166751.938564:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166751.938665:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439961984 00000100:00100000:2.0:1762166751.938672:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439961984 00000100:00100000:2.0:1762166751.938700:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2411 00000100:00100000:2.0:1762166751.938705:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+19:36474:x1847765439961984:12345-192.168.204.38@tcp:36:dd.0 00010000:00010000:2.0:1762166751.938733:0:6496:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166751.938747:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1200/0x2f180c4effb0a5b2 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b73ec expref: 19 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.938771:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2:0x0].0x0 (ffff945bc477fb00) 00010000:00010000:2.0:1762166751.938774:0:6496:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166751.938875:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb0a5ce lrc: 3/0,1 mode: --/PW res: [0x240000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.938883:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb0a5ce lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.938888:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb0a5ce lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000001:00080000:2.0:1762166751.938919:0:6496:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294967353 00000004:00010000:2.0:1762166751.938932:0:6496:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000010d5a3c0 reply state 0000000057380e1e transno 4294967354 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb0a5ce lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.938939:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb0a5ce lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.938943:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2:0x0].0x0 (ffff945bc477fb00) 00010000:00010000:2.0:1762166751.938945:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166751.938946:0:6496:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166751.938991:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+21:36474:x1847765439961984:12345-192.168.204.38@tcp:36:dd.0 Request processed in 285us (430us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1762166751.938995:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2411 00000020:00080000:2.0:1762166751.938999:0:6496:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1762166751.939925:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166751.939962:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439962112 00000100:00100000:2.0:1762166751.939968:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439962112 00000100:00100000:2.0:1762166751.939999:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2412 00000100:00100000:2.0:1762166751.940009:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+21:36474:x1847765439962112:12345-192.168.204.38@tcp:101:dd.0 00010000:00010000:2.0:1762166751.940021:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166751.940039:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0a5d5 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b73fa expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.940070:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0a5d5 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b73fa expref: 22 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.940093:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0a5d5 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b73fa expref: 22 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.940110:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2:0x0].0x0 (ffff945bc477fb00) 00010000:00010000:2.0:1762166751.940113:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166751.940116:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0a00, rc 0) 00000100:00100000:2.0:1762166751.940150:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+22:36474:x1847765439962112:12345-192.168.204.38@tcp:101:dd.0 Request processed in 143us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166751.940158:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2412 00000100:00100000:1.0:1762166751.941257:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166751.941289:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439962368 00000100:00100000:2.0:1762166751.941295:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439962368 00000100:00100000:2.0:1762166751.941321:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2413 00000100:00100000:2.0:1762166751.941330:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+22:36474:x1847765439962368:12345-192.168.204.38@tcp:101:dd.0 00010000:00010000:2.0:1762166751.941341:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166751.941344:0:6496:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1762166751.941361:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0a5d5 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b73fa expref: 22 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.941376:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2:0x0].0x0 (ffff945bc477fb00) 00010000:00010000:2.0:1762166751.941379:0:6496:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166751.941389:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb800/0x2f180c4effb0a5dc lrc: 2/0,0 mode: --/EX res: [0x240000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7401 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.941430:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0a5e3 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.941439:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0a5e3 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.941446:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0a5e3 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000040:00080000:2.0:1762166751.941639:0:6496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 88 off8344 00000004:00080000:2.0:1762166751.941645:0:6496:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 371090167342ns, next at 0ns, rc = 0 00000040:00080000:2.0:1762166751.941670:0:6496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:2.0:1762166751.941674:0:6496:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 371090195863ns, next at 217073438938ns, rc = 0 00000040:00080000:2.0:1762166751.941691:0:6496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8432 00000004:00080000:2.0:1762166751.941695:0:6496:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 371090216931ns, next at 0ns, rc = 0 00000001:00080000:3.0:1762166751.942935:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967355 is committed 00000004:00080000:3.0:1762166751.942941:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3 committed 00000004:00080000:3.0:1762166751.942951:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3 committed 00000004:00080000:3.0:1762166751.942957:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 2 committed 00000020:00080000:3.0:1762166751.942978:0:7412:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff945bc3731b40 refcount 2 committed 0 result 0 batchid 4 00010000:00010000:0.0:1762166751.942978:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb0a48c lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00000020:00080000:3.0:1762166751.942984:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc2d82600 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945bc37313c0 00000020:00080000:3.0:1762166751.942991:0:7412:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000401:0x2:0x0].4 00000020:00080000:3.0:1762166751.942995:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc2d82800 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945cf7889200 00010000:00010000:0.0:1762166751.942997:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb0a48c lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00000020:00080000:3.0:1762166751.942998:0:7412:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000400:0x2:0x0].4 00010000:00010000:0.0:1762166751.943008:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb0a48c lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00000020:00080000:3.0:1762166751.943019:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 4 committed batchid 3 00010000:00010000:0.0:1762166751.943019:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166751.943025:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb0a48c lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166751.943036:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb0a48c lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166751.943050:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x1:0x0].0x0 (ffff945bc477f400) 00010000:00010000:0.0:1762166751.943054:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166751.943058:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0a5e3 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x2:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7401 expref: 13 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166751.943061:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb0a48c lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00000020:00080000:3.0:1762166751.943065:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 3 00010000:00010000:2.0:1762166751.943073:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2:0x0].0x0 (ffff945bc477fb00) 00010000:00010000:0.0:1762166751.943075:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb0a48c lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.943076:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000100:00100000:3.0:1762166751.943096:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5ef4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446767232:0@lo:2:osp-syn-0-1.0 00010000:00010000:2.0:1762166751.943101:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb800/0x2f180c4effb0a5dc lrc: 0/0,0 mode: --/EX res: [0x240000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7401 expref: 13 pid: 6496 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1762166751.943105:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0a493 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166751.943114:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0a493 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.943117:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0a5e3 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x2:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7401 expref: 12 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166751.943130:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0a493 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166751.943137:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166751.943141:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2:0x0].0x0 (ffff945bc477fb00) 00010000:00010000:0.0:1762166751.943141:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0a493 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00000100:00100000:3.0:1762166751.943146:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1762166751.943147:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1762166751.943151:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc29cb600, rc 0) 00010000:00010000:0.0:1762166751.943157:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0a493 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166751.943170:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x4:0x0].0x0 (ffff945bc477fe00) 00010000:00010000:0.0:1762166751.943173:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166751.943176:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0a493 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166751.943182:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0a493 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00000100:00100000:1.0:1762166751.943198:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446767232 00000100:00100000:1.0:1762166751.943205:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446767232 00010000:00010000:0.0:1762166751.943206:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb0a53b lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00000100:00100000:2.0:1762166751.943211:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+11:36474:x1847765439962368:12345-192.168.204.38@tcp:101:dd.0 Request processed in 1878us (1951us total) trans 4294967355 rc 0/0 00010000:00010000:0.0:1762166751.943217:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb0a53b lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00000100:00100000:2.0:1762166751.943224:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2413 00010000:00010000:0.0:1762166751.943229:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb0a53b lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166751.943236:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29ca800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166751.943240:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb0a53b lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00000100:00100000:3.0:1762166751.943241:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5ef6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446766976:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1762166751.943252:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 849 00010000:00010000:0.0:1762166751.943254:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb0a53b lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00000100:00100000:1.0:1762166751.943266:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:3635:x1847765446767232:12345-0@lo:2:osp-syn-0-1.0 00010000:00010000:0.0:1762166751.943267:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x4:0x0].0x8f0a8bfd (ffff945bc477f600) 00010000:00010000:0.0:1762166751.943274:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166751.943279:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb0a53b lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00000100:00100000:3.0:1762166751.943285:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1762166751.943290:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb0a53b lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00000100:00100000:3.0:1762166751.943323:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446767104:0@lo:2:osp-syn-1-1.0 00010000:00010000:0.0:1762166751.943326:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb0a5ce lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166751.943338:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb0a5ce lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166751.943344:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb0a5ce lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166751.943349:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0800 already unused, calling callback (ffffffffc18e2310) 00000100:00100000:3.0:1762166751.943353:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1762166751.943355:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb0a5ce lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166751.943364:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb0a5ce lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166751.943373:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2:0x0].0x0 (ffff945bc477fb00) 00010000:00010000:0.0:1762166751.943377:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166751.943380:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb0a5ce lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166751.943386:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb0a5ce lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00000100:00100000:2.0:1762166751.943409:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446766976 00000100:00100000:3.0:1762166751.943411:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446767104 00000100:00100000:2.0:1762166751.943415:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446766976 00000100:00100000:3.0:1762166751.943417:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446767104 00000100:00100000:2.0:1762166751.943453:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 850 00000100:00100000:3.0:1762166751.943466:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 851 00000100:00100000:2.0:1762166751.943471:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+8:3634:x1847765446766976:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1762166751.943473:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+8:3635:x1847765446767232:12345-0@lo:2:osp-syn-0-1.0 Request processed in 211us (329us total) trans 21474836622 rc 0/0 00000100:00100000:1.0:1762166751.943501:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 849 00000100:00080000:0.0:1762166751.943515:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1762166751.943536:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5ef4700/2, rc 0, transno 21474836622 00000100:00100000:1.0:1762166751.943540:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5ef4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446767232:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166751.943560:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3634:x1847765446767104:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1762166751.943656:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+8:3634:x1847765446766976:12345-0@lo:2:osp-syn-0-1.0 Request processed in 195us (379us total) trans 21474836623 rc 0/0 00000100:00100000:2.0:1762166751.943665:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 850 00000004:00080000:0.0:1762166751.943682:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5ef6a00/2, rc 0, transno 21474836623 00000100:00100000:0.0:1762166751.943689:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5ef6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446766976:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166751.943892:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+6:3634:x1847765446767104:12345-0@lo:2:osp-syn-1-1.0 Request processed in 416us (540us total) trans 17179869310 rc 0/0 00000100:00100000:3.0:1762166751.943900:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 851 00000004:00080000:0.0:1762166751.943914:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5bbb480/2, rc 0, transno 17179869310 00000100:00100000:0.0:1762166751.943922:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446767104:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1762166751.945109:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166751.945142:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439962496 00000100:00100000:3.0:1762166751.945147:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439962496 00000100:00100000:3.0:1762166751.945171:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 852 00000100:00100000:3.0:1762166751.945183:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c5f20b66-016a-4159-9d62-071c0da3ef0b+5:36474:x1847765439962496:12345-192.168.204.38@tcp:101:dd.0 00010000:00010000:3.0:1762166751.945192:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166751.945203:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cf3dc7c00/0x2f180c4effb0a5ea lrc: 2/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7408 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166751.945216:0:28874:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1762166751.945227:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166751.945229:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166751.945233:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cf3dc7c00/0x2f180c4effb0a5ea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7408 expref: 6 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166751.945243:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945cf3dc7c00/0x2f180c4effb0a5ea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7408 expref: 6 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166751.945249:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3dc7c00, rc 0) 00000100:00100000:3.0:1762166751.945275:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c5f20b66-016a-4159-9d62-071c0da3ef0b+6:36474:x1847765439962496:12345-192.168.204.38@tcp:101:dd.0 Request processed in 93us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166751.945280:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 852 00000100:00100000:2.0:1762166751.946154:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166751.946206:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439962624 00000100:00100000:3.0:1762166751.946209:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439962624 00002000:00010000:3.0:1762166751.946229:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/17 (0->18446744073709551615) 00002000:00100000:3.0:1762166751.946233:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bbad80 with x1847765439962624 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166751.946240:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc5bbad80. 00000100:00100000:3.0:1762166751.946263:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 424 00000100:00100000:3.0:1762166751.946270:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c5f20b66-016a-4159-9d62-071c0da3ef0b+6:2419:x1847765439962624:12345-192.168.204.38@tcp:10:dd.0 00002000:00010000:3.0:1762166751.946377:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x11:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166751.946381:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x11:0x0] updating lvb mtime from disk: 0 -> 1762166752 00002000:00010000:3.0:1762166751.946389:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x11:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1762166751.946391:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x11:0x0] updating lvb ctime from disk: 0 -> 1762166752 00002000:00010000:3.0:1762166751.946393:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x11:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166751.946419:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c5f20b66-016a-4159-9d62-071c0da3ef0b+7:2419:x1847765439962624:12345-192.168.204.38@tcp:10:dd.0 Request processed in 151us (266us total) trans 21474836624 rc 0/0 00000100:00100000:3.0:1762166751.946425:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 424 00002000:00010000:3.0:1762166751.946427:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/17 (0->18446744073709551615) 00002000:00100000:3.0:1762166751.946429:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bbad80 with x1847765439962624 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166751.946432:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc5bbad80. 00000100:00100000:1.0:1762166751.958726:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166751.958803:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439962880 00000100:00100000:2.0:1762166751.958816:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439962880 00000100:00100000:2.0:1762166751.958887:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 695 00000100:00100000:2.0:1762166751.958899:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+9:36474:x1847765439962880:12345-192.168.204.38@tcp:35:dd.0 00000100:00100000:2.0:1762166751.959326:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+10:36474:x1847765439962880:12345-192.168.204.38@tcp:35:dd.0 Request processed in 429us (616us total) trans 4294967356 rc 0/0 00000100:00100000:2.0:1762166751.959332:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 695 00000100:00100000:1.0:1762166751.971451:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166751.971539:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439963136 00000100:00100000:2.0:1762166751.971554:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439963136 00000100:00100000:2.0:1762166751.971631:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2414 00000100:00100000:2.0:1762166751.971643:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+10:36476:x1847765439963136:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166751.971673:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166751.971702:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb800/0x2f180c4effb0a5f1 lrc: 2/0,0 mode: --/CR res: [0x240000400:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b740f expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.971805:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb000/0x2f180c4effb0a5f8 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.971841:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb000/0x2f180c4effb0a5f8 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.971854:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb000/0x2f180c4effb0a5f8 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.971867:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb0a5ff lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.971872:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb0a5ff lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.971875:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb0a5ff lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.971957:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb000/0x2f180c4effb0a5f8 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.971963:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb000/0x2f180c4effb0a5f8 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.971969:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb000/0x2f180c4effb0a5f8 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.971976:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb000/0x2f180c4effb0a5f8 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.971982:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29cb000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166751.971986:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb000/0x2f180c4effb0a5f8 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.971993:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb000/0x2f180c4effb0a5f8 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.972016:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x4:0x0].0x0 (ffff945bc477f100) 00010000:00010000:2.0:1762166751.972019:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166751.972024:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb000/0x2f180c4effb0a5f8 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.972031:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb000/0x2f180c4effb0a5f8 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.972047:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb0a5ff lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.972051:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb0a5ff lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.972054:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb0a5ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.972057:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29ca800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166751.972059:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb0a5ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.972062:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb0a5ff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.972066:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x4:0x0].0x8f0a8bfd (ffff945bc477f900) 00010000:00010000:2.0:1762166751.972067:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166751.972069:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb0a5ff lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.972071:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb0a5ff lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.972114:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb800/0x2f180c4effb0a5f1 lrc: 1/0,0 mode: --/CR res: [0x240000400:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b740f expref: 11 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.972128:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x4:0x0].0x0 (ffff945bc477f100) 00010000:00010000:2.0:1762166751.972129:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1762166751.972132:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb800/0x2f180c4effb0a5f1 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b740f expref: 11 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.972140:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc29cb800, rc 0) 00000100:00100000:2.0:1762166751.972203:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+10:36476:x1847765439963136:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 563us (771us total) trans 0 rc 301/301 00000100:00100000:2.0:1762166751.972211:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2414 00000100:00100000:1.0:1762166751.973860:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166751.973912:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439963392 00000100:00100000:2.0:1762166751.973921:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439963392 00000100:00100000:2.0:1762166751.973974:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2415 00000100:00100000:2.0:1762166751.973984:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+10:36476:x1847765439963392:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166751.974003:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166751.974023:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0a606 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7416 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.974179:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0a60d lrc: 3/1,0 mode: --/CR res: [0x240000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.974189:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0a60d lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.974197:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0a60d lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000004:00200000:2.0:1762166751.974206:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000403:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1762166751.974310:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0a606 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7416 expref: 13 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.974354:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0a60d lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7416 expref: 12 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.974361:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x1:0x0].0x0 (ffff945bc477f400) 00010000:00010000:2.0:1762166751.974364:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1762166751.974366:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0a00, rc 0) 00000100:00100000:2.0:1762166751.974428:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+12:36476:x1847765439963392:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 444us (576us total) trans 4294967357 rc 0/0 00000100:00100000:2.0:1762166751.974436:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2415 00000100:00100000:1.0:1762166751.975709:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166751.975763:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439963520 00000100:00100000:2.0:1762166751.975771:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439963520 00000100:00100000:2.0:1762166751.975823:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2416 00000100:00100000:2.0:1762166751.975834:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+12:36476:x1847765439963520:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:2.0:1762166751.975904:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1200/0x2f180c4effb0a61b lrc: 3/1,0 mode: --/CR res: [0x240000400:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.975915:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1200/0x2f180c4effb0a61b lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.975922:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1200/0x2f180c4effb0a61b lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.975930:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb0a622 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.975934:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb0a622 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.975938:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb0a622 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.976006:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0a629 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.976012:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0a629 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.976016:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0a629 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000004:00200000:2.0:1762166751.976051:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000403:0x2:0x0]: returning size 1048576 00000004:00200000:2.0:1762166751.976055:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166751.976067:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0a629 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.976081:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1200/0x2f180c4effb0a61b lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.976101:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1200/0x2f180c4effb0a61b lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.976106:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1200/0x2f180c4effb0a61b lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.976112:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1200/0x2f180c4effb0a61b lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.976118:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166751.976122:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1200/0x2f180c4effb0a61b lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.976130:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1200/0x2f180c4effb0a61b lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.976140:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x4:0x0].0x0 (ffff945bc477fa00) 00010000:00010000:2.0:1762166751.976150:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166751.976155:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1200/0x2f180c4effb0a61b lrc: 3/0,0 mode: --/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.976162:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1200/0x2f180c4effb0a61b lrc: 0/0,0 mode: --/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.976181:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb0a622 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.976187:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb0a622 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.976193:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb0a622 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.976198:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166751.976201:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb0a622 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.976206:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb0a622 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.976212:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x4:0x0].0x8f0a8bfd (ffff945bc477f000) 00010000:00010000:2.0:1762166751.976214:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166751.976216:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb0a622 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.976219:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb0a622 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.976228:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0a629 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.976231:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0a629 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.976239:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0a629 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.976242:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166751.976244:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0a629 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.976247:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0a629 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.976251:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2:0x0].0x0 (ffff945bc477fb00) 00010000:00010000:2.0:1762166751.976252:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166751.976254:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0a629 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.976256:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0a629 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00000100:00100000:2.0:1762166751.976316:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+12:36476:x1847765439963520:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 484us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166751.976325:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2416 00000100:00100000:1.0:1762166751.985417:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166751.985473:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439963648 00000100:00100000:2.0:1762166751.985519:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439963648 00000100:00100000:2.0:1762166751.985594:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2417 00000100:00100000:2.0:1762166751.985609:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+12:36478:x1847765439963648:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166751.985636:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166751.985673:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb0a630 lrc: 2/0,0 mode: --/CR res: [0x240000400:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b741d expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.985757:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0a637 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.985795:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0a637 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.985808:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0a637 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.985823:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0a63e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.985830:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0a63e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.985836:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0a63e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.985918:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0a645 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.985927:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0a645 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.985934:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0a645 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000004:00200000:2.0:1762166751.985983:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000403:0x2:0x0]: returning size 1048576 00000004:00200000:2.0:1762166751.985989:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166751.986010:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0a645 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.986023:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0a645 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.986033:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0a637 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.986046:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0a637 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.986050:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0a637 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.986054:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0a637 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.986058:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166751.986061:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0a637 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.986067:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0a637 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.986077:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x4:0x0].0x0 (ffff945bc477f100) 00010000:00010000:2.0:1762166751.986080:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166751.986096:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0a637 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.986102:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0a637 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.986114:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0a63e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.986117:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0a63e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.986122:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0a63e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.986127:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166751.986137:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0a63e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.986142:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0a63e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.986150:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x4:0x0].0x8f0a8bfd (ffff945bc477f900) 00010000:00010000:2.0:1762166751.986153:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166751.986156:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0a63e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.986162:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0a63e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.986204:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb0a630 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b741d expref: 14 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.986222:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0a645 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b741d expref: 13 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.986230:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2:0x0].0x0 (ffff945bc477fb00) 00010000:00010000:2.0:1762166751.986233:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166751.986235:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0600, rc 0) 00000100:00100000:2.0:1762166751.986317:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+13:36478:x1847765439963648:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 712us (912us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166751.986325:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2417 00000100:00100000:1.0:1762166751.988704:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166751.988751:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439963904 00000100:00100000:2.0:1762166751.988763:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439963904 00000100:00100000:2.0:1762166751.988825:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2418 00000100:00100000:2.0:1762166751.988836:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+13:36478:x1847765439963904:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166751.988875:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166751.988896:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb0a64c lrc: 2/0,0 mode: --/CR res: [0x240000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7424 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.989016:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0a653 lrc: 3/0,1 mode: --/CW res: [0x240000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.989032:0:6496:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0a645 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b741d expref: 14 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.989040:0:6496:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0a653 lrc: 4/0,1 mode: --/CW res: [0x240000403:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.989077:0:6496:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0a645 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b741d expref: 14 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.989104:0:6496:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0a645 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b741d expref: 14 pid: 6496 timeout: 471 lvb_type: 0 00000100:00100000:2.0:1762166751.989120:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bba300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6496:1847765446767360:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166751.989228:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc3731f00 going to sleep for 11 seconds 00000100:00100000:2.0:1762166751.990258:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bba300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6496:1847765446767360:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166751.990290:0:6496:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0a653 lrc: 3/0,1 mode: --/CW res: [0x240000403:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000100:00100000:1.0:1762166751.990459:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166751.990533:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439964032 00000100:00100000:3.0:1762166751.990542:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439964032 00010000:00010000:3.0:1762166751.990574:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0a645 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b741d expref: 15 pid: 6496 timeout: 471 lvb_type: 0 00000100:00100000:3.0:1762166751.990614:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 560 00000100:00100000:3.0:1762166751.990625:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cceb49450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+15:2418:x1847765439964032:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166751.990640:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166751.990647:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0a645 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b741d expref: 15 pid: 6496 timeout: 471 lvb_type: 0 00010000:00010000:3.0:1762166751.990660:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0a645 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b741d expref: 15 pid: 6496 timeout: 471 lvb_type: 0 00010000:00010000:3.0:1762166751.990681:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0a645 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b741d expref: 15 pid: 6496 timeout: 471 lvb_type: 0 00010000:00010000:3.0:1762166751.990696:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2:0x0].0x0 (ffff945bc477fb00) 00010000:00010000:3.0:1762166751.990700:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0a653 lrc: 3/0,1 mode: --/CW res: [0x240000403:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166751.990720:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0a653 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166751.990727:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0a653 lrc: 4/0,1 mode: CW/CW res: [0x240000403:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166751.990754:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166751.990784:0:6496:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0a653 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.990792:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0a653 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000004:00200000:2.0:1762166751.990822:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000403:0x2:0x0]: returning size 1048576 00000100:00100000:3.0:1762166751.990828:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cceb49450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+14:2418:x1847765439964032:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 203us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166751.990837:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 560 00010000:00010000:2.0:1762166751.990971:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb0a64c lrc: 0/0,0 mode: --/CR res: [0x240000403:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7424 expref: 15 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.990989:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0a653 lrc: 3/0,0 mode: CW/CW res: [0x240000403:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7424 expref: 14 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.990998:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2:0x0].0x0 (ffff945bc477fb00) 00010000:00010000:2.0:1762166751.991000:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1762166751.991003:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc29cba00, rc 0) 00000100:00100000:2.0:1762166751.991043:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+14:36478:x1847765439963904:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2208us (2351us total) trans 4294967358 rc 0/0 00000100:00100000:2.0:1762166751.991051:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2418 00000100:00100000:1.0:1762166751.992981:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166751.993022:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439964160 00000100:00100000:2.0:1762166751.993032:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439964160 00000100:00100000:2.0:1762166751.993103:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2419 00000100:00100000:2.0:1762166751.993109:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+14:36478:x1847765439964160:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166751.993126:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166751.993139:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb800/0x2f180c4effb0a661 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b742b expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.993211:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb0a668 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.993223:0:6496:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0a653 lrc: 2/0,0 mode: CW/CW res: [0x240000403:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7424 expref: 15 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.993230:0:6496:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb0a668 lrc: 4/1,0 mode: --/PR res: [0x240000403:0x2:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.993266:0:6496:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0a653 lrc: 3/0,0 mode: CW/CW res: [0x240000403:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7424 expref: 15 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.993279:0:6496:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0a653 lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7424 expref: 15 pid: 6496 timeout: 471 lvb_type: 0 00000100:00100000:2.0:1762166751.993292:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bba300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6496:1847765446767488:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166751.993379:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc37313c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166751.994455:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bba300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6496:1847765446767488:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166751.994470:0:6496:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb0a668 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x2:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000100:00100000:1.0:1762166751.994646:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166751.994678:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439964288 00000100:00100000:3.0:1762166751.994688:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439964288 00010000:00010000:3.0:1762166751.994724:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0a653 lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7424 expref: 16 pid: 6496 timeout: 471 lvb_type: 0 00000100:00100000:3.0:1762166751.994765:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 561 00000100:00100000:3.0:1762166751.994776:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+16:2419:x1847765439964288:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166751.994792:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166751.994800:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0a653 lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7424 expref: 16 pid: 6496 timeout: 471 lvb_type: 0 00010000:00010000:3.0:1762166751.994815:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0a653 lrc: 3/0,0 mode: CW/CW res: [0x240000403:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7424 expref: 16 pid: 6496 timeout: 471 lvb_type: 0 00010000:00010000:3.0:1762166751.994840:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0a653 lrc: 0/0,0 mode: --/CW res: [0x240000403:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7424 expref: 16 pid: 6496 timeout: 471 lvb_type: 0 00010000:00010000:3.0:1762166751.994859:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2:0x0].0x0 (ffff945bc477fb00) 00010000:00010000:3.0:1762166751.994874:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb0a668 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x2:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166751.994883:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb0a668 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166751.994891:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb0a668 lrc: 4/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166751.994924:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166751.994953:0:6496:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb0a668 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.994963:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb0a668 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000100:00100000:3.0:1762166751.994978:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+15:2419:x1847765439964288:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 200us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166751.994989:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 561 00000004:00200000:2.0:1762166751.995008:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000403:0x2:0x0]: returning size 1048576 00000004:00200000:2.0:1762166751.995014:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166751.995029:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb0a668 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.995059:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb800/0x2f180c4effb0a661 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b742b expref: 15 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.995072:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb0a668 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b742b expref: 14 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.995105:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2:0x0].0x0 (ffff945bc477fb00) 00010000:00010000:2.0:1762166751.995108:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166751.995110:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc29ca800, rc 0) 00000100:00100000:2.0:1762166751.995153:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+14:36478:x1847765439964160:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2045us (2179us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166751.995160:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2419 00000100:00100000:1.0:1762166751.996730:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166751.996781:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439964544 00000100:00100000:2.0:1762166751.996790:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439964544 00000100:00100000:2.0:1762166751.996833:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2420 00000100:00100000:2.0:1762166751.996844:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+14:36478:x1847765439964544:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166751.996860:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166751.996874:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb000/0x2f180c4effb0a66f lrc: 2/0,0 mode: --/CR res: [0x240000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7432 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.996959:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb0a676 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166751.996973:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb0a676 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x2:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166751.996981:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb0a676 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x2:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000004:00200000:2.0:1762166751.996989:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000403:0x2:0x0]: returning size 1048576 00010000:00010000:2.0:1762166751.997073:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb000/0x2f180c4effb0a66f lrc: 0/0,0 mode: --/CR res: [0x240000403:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7432 expref: 17 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.997096:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb0a676 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x2:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7432 expref: 16 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166751.997110:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2:0x0].0x0 (ffff945bc477fb00) 00010000:00010000:2.0:1762166751.997113:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166751.997114:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b1c00, rc 0) 00000100:00100000:2.0:1762166751.997146:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+16:36478:x1847765439964544:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 305us (421us total) trans 4294967359 rc 0/0 00000100:00100000:2.0:1762166751.997150:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2420 00000100:00100000:1.0:1762166751.998153:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166751.998211:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439964672 00000100:00100000:3.0:1762166751.998220:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439964672 00000100:00100000:3.0:1762166751.998281:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 853 00000100:00100000:3.0:1762166751.998293:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c5f20b66-016a-4159-9d62-071c0da3ef0b+7:2419:x1847765439964672:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:3.0:1762166751.998338:0:28874:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945cf3dc6e00/0x2f180c4effb0a684 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166751.998357:0:28874:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945cf3dc7c00/0x2f180c4effb0a5ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7408 expref: 7 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166751.998367:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166751.998369:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166751.998373:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cf3dc6e00/0x2f180c4effb0a684 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166751.998412:0:28874:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945cf3dc7c00/0x2f180c4effb0a5ea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7408 expref: 7 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166751.998446:0:28874:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945cf3dc7c00/0x2f180c4effb0a5ea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7408 expref: 7 pid: 28874 timeout: 471 lvb_type: 0 00000100:00100000:3.0:1762166751.998464:0:28874:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1e6c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28874:1847765446767616:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166751.998592:0:28874:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1fbe0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166751.999509:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1e6c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28874:1847765446767616:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166751.999535:0:28874:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945cf3dc6e00/0x2f180c4effb0a684 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166752.000333:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166752.000395:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439964800 00000100:00100000:3.0:1762166752.000402:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439964800 00002000:00100000:3.0:1762166752.000443:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000400:0x11:0x0] (0->1048575) req@ffff945bc5ef6680 x1847765439964800/t0(0) o4->c5f20b66-016a-4159-9d62-071c0da3ef0b@192.168.204.38@tcp:538/0 lens 488/0 e 0 to 0 dl 1762166763 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166752.000452:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5ef6680 with x1847765439964800 ext(0->1048575) 00010000:00010000:3.0:1762166752.000458:0:23942:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff945cf3dc7c00/0x2f180c4effb0a5ea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7408 expref: 8 pid: 28874 timeout: 471 lvb_type: 0 00010000:00010000:3.0:1762166752.000468:0:23942:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff945cf3dc7c00/0x2f180c4effb0a5ea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7408 expref: 8 pid: 28874 timeout: 471 lvb_type: 0 00002000:00010000:3.0:1762166752.000474:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff945bc5ef6680 00000100:00100000:3.0:1762166752.000522:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 10 00000100:00100000:3.0:1762166752.000529:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c5f20b66-016a-4159-9d62-071c0da3ef0b+8:2418:x1847765439964800:12345-192.168.204.38@tcp:4:dd.0 00000100:00100000:3.0:1762166752.008130:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c5f20b66-016a-4159-9d62-071c0da3ef0b+10:2418:x1847765439964800:12345-192.168.204.38@tcp:4:dd.0 Request processed in 7592us (7789us total) trans 21474836625 rc 0/0 00000100:00100000:3.0:1762166752.008143:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 10 00002000:00100000:3.0:1762166752.008155:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000400:0x11:0x0] (0->1048575) req@ffff945bc5ef6680 x1847765439964800/t21474836625(0) o4->c5f20b66-016a-4159-9d62-071c0da3ef0b@192.168.204.38@tcp:538/0 lens 488/448 e 0 to 0 dl 1762166763 ref 1 fl Complete:H/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166752.008165:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5ef6680 with x1847765439964800 ext(0->1048575) 00010000:00010000:3.0:1762166752.008174:0:23942:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff945cf3dc7c00/0x2f180c4effb0a5ea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7408 expref: 10 pid: 28874 timeout: 471 lvb_type: 0 00010000:00010000:3.0:1762166752.008189:0:23942:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff945cf3dc7c00/0x2f180c4effb0a5ea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7408 expref: 10 pid: 28874 timeout: 471 lvb_type: 0 00002000:00010000:3.0:1762166752.008196:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff945bc5ef6680 00000100:00100000:3.0:1762166752.010623:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166752.010674:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439964928 00000100:00100000:2.0:1762166752.010684:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439964928 00010000:00010000:2.0:1762166752.010717:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945cf3dc7c00/0x2f180c4effb0a5ea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7408 expref: 10 pid: 28874 timeout: 471 lvb_type: 0 00000100:00100000:2.0:1762166752.010757:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 562 00000100:00100000:2.0:1762166752.010769:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+10:2417:x1847765439964928:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166752.010785:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1762166752.010802:0:8398:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x11:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:2.0:1762166752.010805:0:8398:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x11:0x0] updating lvb blocks from disk: 0 -> 2048 00010000:00010000:2.0:1762166752.010811:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945cf3dc7c00/0x2f180c4effb0a5ea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7408 expref: 10 pid: 28874 timeout: 471 lvb_type: 0 00010000:00010000:2.0:1762166752.010825:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945cf3dc7c00/0x2f180c4effb0a5ea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7408 expref: 10 pid: 28874 timeout: 471 lvb_type: 0 00010000:00010000:2.0:1762166752.010845:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cf3dc7c00/0x2f180c4effb0a5ea lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7408 expref: 10 pid: 28874 timeout: 471 lvb_type: 0 00010000:00010000:2.0:1762166752.010871:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166752.010873:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166752.010877:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945cf3dc6e00/0x2f180c4effb0a684 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166752.010884:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cf3dc6e00/0x2f180c4effb0a684 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166752.010908:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166752.010929:0:28874:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945cf3dc6e00/0x2f180c4effb0a684 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166752.010941:0:28874:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cf3dc6e00/0x2f180c4effb0a684 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166752.010958:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+9:2417:x1847765439964928:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 190us (341us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166752.010962:0:28874:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945cf3dc6e00/0x2f180c4effb0a684 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166752.010969:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 562 00010000:00010000:3.0:1762166752.010978:0:28874:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945cf3dc6e00/0x2f180c4effb0a684 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166752.011004:0:28874:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945cf3dc6e00/0x2f180c4effb0a684 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166752.011011:0:28874:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3dc6e00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166752.011016:0:28874:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945cf3dc6e00/0x2f180c4effb0a684 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166752.011025:0:28874:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945cf3dc6e00/0x2f180c4effb0a684 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166752.011037:0:28874:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945cf3dc6e00/0x2f180c4effb0a684 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166752.011044:0:28874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cf3dc6e00/0x2f180c4effb0a684 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166752.011103:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c5f20b66-016a-4159-9d62-071c0da3ef0b+8:2419:x1847765439964672:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 12812us (12954us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166752.011111:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 853 00000100:00100000:1.0:1762166752.012508:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166752.012557:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439965184 00000100:00100000:2.0:1762166752.012565:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439965184 00000100:00100000:2.0:1762166752.012605:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2421 00000100:00100000:2.0:1762166752.012615:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+16:36478:x1847765439965184:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:2.0:1762166752.012661:0:6496:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1762166752.012679:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0a5e3 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x2:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7401 expref: 16 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166752.012692:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb0a668 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b742b expref: 15 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166752.012699:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2:0x0].0x0 (ffff945bc477fb00) 00010000:00010000:2.0:1762166752.012702:0:6496:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166752.012722:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb0a68b lrc: 3/0,1 mode: --/EX res: [0x240000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166752.012738:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb0a68b lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166752.012744:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb0a68b lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000040:00080000:2.0:1762166752.012942:0:6496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 88 off8520 00000004:00080000:2.0:1762166752.012952:0:6496:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 371161473545ns, next at 0ns, rc = 0 00000040:00080000:2.0:1762166752.012999:0:6496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 88 off8496 00000004:00080000:2.0:1762166752.013006:0:6496:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 371161528428ns, next at 217073438938ns, rc = 0 00000040:00080000:2.0:1762166752.013042:0:6496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8608 00000004:00080000:2.0:1762166752.013048:0:6496:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 371161570062ns, next at 0ns, rc = 0 00000001:00080000:2.0:1762166752.014198:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967360 is committed 00000004:00080000:2.0:1762166752.014205:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 5 committed 00000004:00080000:2.0:1762166752.014222:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 4 committed 00000004:00080000:2.0:1762166752.014229:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 4 committed 00000020:00080000:2.0:1762166752.014244:0:7412:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0001: 4 batchid updated 00000004:00010000:2.0:1762166752.014293:0:6496:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000047dbdbe8 reply state 00000000a4343082 transno 4294967360 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb0a68b lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000100:00100000:3.0:1762166752.014300:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000020:00080000:0.0:1762166752.014305:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4 00010000:00010000:2.0:1762166752.014312:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb0a68b lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166752.014320:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2:0x0].0x0 (ffff945bc477fb00) 00000100:00100000:3.0:1762166752.014321:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5ef7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446767872:0@lo:2:osp-syn-0-1.0 00010000:00010000:2.0:1762166752.014323:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1762166752.014325:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5ef5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446768000:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1762166752.014329:0:6496:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000004:00080000:0.0:1762166752.014362:0:7435:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff945ceffd4780 with version 11 00000100:00100000:1.0:1762166752.014382:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1762166752.014385:0:7435:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4 cancel update log [0x200000401:0x2:0x0].4: rc = 0 00000100:00100000:3.0:1762166752.014408:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446768000 00010000:00080000:2.0:1762166752.014414:0:6496:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1762166752.014415:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446768000 00000100:00100000:2.0:1762166752.014432:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+11:36478:x1847765439965184:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 1817us (1954us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1762166752.014442:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2421 00000020:00080000:0.0:1762166752.014453:0:7435:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4 cancel update log [0x240000400:0x2:0x0].4: rc = 0 00000100:00100000:1.0:1762166752.014454:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166752.014461:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 854 00000020:00080000:0.0:1762166752.014470:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4 00000100:00100000:3.0:1762166752.014471:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5588700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+8:3633:x1847765446768000:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1762166752.014494:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446767872 00000100:00100000:2.0:1762166752.014499:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446767872 00000100:00100000:1.0:1762166752.014502:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1e6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446767744:0@lo:2:osp-syn-1-1.0 00000004:00080000:0.0:1762166752.014504:0:7425:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff945cc6268300 version 11 rpc_version 11 00000100:00100000:2.0:1762166752.014523:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 855 00000100:00100000:2.0:1762166752.014531:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+9:3635:x1847765446767872:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1762166752.014538:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00100000:0.0:1762166752.014544:0:7425:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1762166752.014555:0:7425:0:(client.c:796:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff945d011e9180 x1847765446768256/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1762166752.014574:0:7425:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945d011e9180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7425:1847765446768256:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1762166752.014617:0:7425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166752.014641:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+11:3635:x1847765446767872:12345-0@lo:2:osp-syn-0-1.0 Request processed in 110us (188us total) trans 21474836626 rc 0/0 00000100:00100000:3.0:1762166752.014649:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5588700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+11:3633:x1847765446768000:12345-0@lo:2:osp-syn-0-1.0 Request processed in 178us (264us total) trans 21474836627 rc 0/0 00000100:00100000:0.0:1762166752.014652:0:7425:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7c77d80 going to sleep for 11 seconds 00000100:00100000:2.0:1762166752.014657:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 855 00000100:00100000:3.0:1762166752.014665:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 854 00000100:00100000:2.0:1762166752.014677:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446767744 00000004:00080000:1.0:1762166752.014677:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5ef5880/2, rc 0, transno 21474836627 00000100:00100000:2.0:1762166752.014683:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446767744 00000100:00100000:1.0:1762166752.014687:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5ef5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446768000:0@lo:2:osp-syn-0-1.0 00010000:00010000:0.0:1762166752.014705:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb0a68b lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00000004:00080000:1.0:1762166752.014715:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5ef7800/2, rc 0, transno 21474836626 00000100:00100000:2.0:1762166752.014719:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 856 00010000:00010000:0.0:1762166752.014719:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb0a68b lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00000100:00100000:1.0:1762166752.014724:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5ef7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446767872:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1762166752.014734:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5588000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3635:x1847765446767744:12345-0@lo:2:osp-syn-1-1.0 00010000:00010000:0.0:1762166752.014737:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb0a68b lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00000100:00100000:1.0:1762166752.014748:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446768256 00000100:00100000:1.0:1762166752.014754:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446768256 00010000:00010000:0.0:1762166752.014769:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166752.014776:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb0a68b lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166752.014784:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb0a68b lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00000100:00100000:1.0:1762166752.014785:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 533 00000100:00100000:1.0:1762166752.014798:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:7425:x1847765446768256:12345-0@lo:1000:osp_up0-1.0 00010000:00010000:0.0:1762166752.014801:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2:0x0].0x0 (ffff945bc477fb00) 00010000:00010000:0.0:1762166752.014806:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166752.014810:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb0a68b lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166752.014816:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb0a68b lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00000100:00100000:2.0:1762166752.014858:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5588000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+7:3635:x1847765446767744:12345-0@lo:2:osp-syn-1-1.0 Request processed in 126us (320us total) trans 17179869311 rc 0/0 00000100:00100000:2.0:1762166752.014865:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 856 00000004:00080000:3.0:1762166752.014873:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf1e6f800/2, rc 0, transno 17179869311 00000100:00100000:3.0:1762166752.014880:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1e6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446767744:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1762166752.014922:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:7425:x1847765446768256:12345-0@lo:1000:osp_up0-1.0 Request processed in 127us (305us total) trans 4294968785 rc 0/0 00000100:00100000:1.0:1762166752.014929:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 533 00000100:00100000:0.0:1762166752.014967:0:7425:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945d011e9180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7425:1847765446768256:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1762166752.016380:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166752.016535:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439965312 00000100:00100000:2.0:1762166752.016542:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439965312 00000100:00100000:2.0:1762166752.016582:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2422 00000100:00100000:2.0:1762166752.016591:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+10:36478:x1847765439965312:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166752.016615:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166752.016632:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0a692 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7439 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166752.016681:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0a692 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7439 expref: 11 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166752.016694:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0a692 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7439 expref: 11 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166752.016739:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2:0x0].0x0 (ffff945bc477fb00) 00010000:00010000:2.0:1762166752.016742:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166752.016745:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0200, rc 0) 00000100:00100000:2.0:1762166752.016793:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+11:36478:x1847765439965312:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 202us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166752.016801:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2422 00000100:00100000:3.0:1762166752.018284:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166752.018338:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439965440 00000100:00100000:2.0:1762166752.018345:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439965440 00000100:00100000:2.0:1762166752.018380:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2423 00000100:00100000:2.0:1762166752.018388:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+11:36478:x1847765439965440:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166752.018400:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166752.018412:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0a699 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7440 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166752.018516:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0a6a0 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166752.018528:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0a6a0 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166752.018539:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0a6a0 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000004:00200000:2.0:1762166752.018566:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000403:0x2:0x0]: returning size 1048576 00000004:00200000:2.0:1762166752.018571:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:3.0:1762166752.018581:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000004:00080000:0.0:1762166752.018587:0:9164:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 371167107993ns, next at 372167105368ns, rc = 0 00000004:00010000:2.0:1762166752.018588:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0a6a0 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000100:00100000:3.0:1762166752.018600:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc47b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446768384:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1762166752.018612:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166752.018619:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0a699 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7440 expref: 13 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166752.018644:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0a6a0 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7440 expref: 12 pid: 6496 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166752.018650:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1762166752.018658:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2:0x0].0x0 (ffff945bc477fb00) 00010000:00010000:2.0:1762166752.018662:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166752.018665:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b1e00, rc 0) 00000100:00100000:1.0:1762166752.018702:0:8385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446768384 00000100:00100000:1.0:1762166752.018708:0:8385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446768384 00000100:00100000:2.0:1762166752.018714:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+12:36478:x1847765439965440:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 318us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166752.018726:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2423 00000100:00100000:1.0:1762166752.018754:0:8385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1762166752.018765:0:8385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4530000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3633:x1847765446768384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1762166752.018782:0:8385:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 16080576 pending 1073152 free 3922436096 avail 3690913792 00000100:00100000:1.0:1762166752.018831:0:8385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4530000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3633:x1847765446768384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166752.018838:0:8385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1762166752.018865:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc47b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446768384:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1762166752.020068:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166752.020114:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439965568 00000100:00100000:2.0:1762166752.020119:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439965568 00000100:00100000:2.0:1762166752.020146:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 857 00000100:00100000:2.0:1762166752.020153:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5589f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+8:2417:x1847765439965568:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166752.020164:0:8382:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166752.020179:0:8382:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0a6a7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7447 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166752.020198:0:8382:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 1048576, mtime: 0x690887e0, atime: 0x0, ctime: 0x690887e0, blocks: 0x800 00010000:00010000:2.0:1762166752.020211:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166752.020212:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166752.020218:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0a6a7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7447 expref: 9 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166752.020229:0:8382:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0a6a7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7447 expref: 9 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166752.020253:0:8382:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0800, rc 0) 00000100:00100000:2.0:1762166752.020288:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5589f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+9:2417:x1847765439965568:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 135us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166752.020296:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 857 00000100:00100000:3.0:1762166752.056540:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166752.056613:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439965696 00000100:00100000:2.0:1762166752.056622:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439965696 00000100:00100000:2.0:1762166752.056667:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 858 00000100:00100000:2.0:1762166752.056674:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4530700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+9:2417:x1847765439965696:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:2.0:1762166752.056774:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4530700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+9:2417:x1847765439965696:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 99us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166752.056781:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 858 00000100:00100000:3.0:1762166752.058236:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166752.058282:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439965824 00000100:00100000:2.0:1762166752.058287:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439965824 00000100:00100000:2.0:1762166752.058320:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 859 00000100:00100000:2.0:1762166752.058331:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4533b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+9:2416:x1847765439965824:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:2.0:1762166752.058394:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4533b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+9:2416:x1847765439965824:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 68us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166752.058399:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 859 00000100:00100000:1.0:1762166752.060277:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166752.060319:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439965952 00000100:00100000:3.0:1762166752.060325:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439965952 00000100:00100000:3.0:1762166752.060375:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 425 00000100:00100000:3.0:1762166752.060381:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c5f20b66-016a-4159-9d62-071c0da3ef0b+9:2416:x1847765439965952:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:3.0:1762166752.060402:0:23942:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945cf3dc6e00/0x2f180c4effb0a6ae lrc: 3/1,0 mode: --/PR res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166752.060415:0:23942:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166752.060418:0:23942:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166752.060424:0:23942:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cf3dc6e00/0x2f180c4effb0a6ae lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166752.060436:0:23942:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cf3dc6e00/0x2f180c4effb0a6ae lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166752.064928:0:23942:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945cf3dc6e00/0x2f180c4effb0a6ae lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166752.064943:0:23942:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945cf3dc6e00/0x2f180c4effb0a6ae lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166752.064952:0:23942:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945cf3dc6e00/0x2f180c4effb0a6ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166752.064969:0:23942:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3dc6e00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166752.064973:0:23942:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945cf3dc6e00/0x2f180c4effb0a6ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166752.064980:0:23942:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945cf3dc6e00/0x2f180c4effb0a6ae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166752.064997:0:23942:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945cf3dc6e00/0x2f180c4effb0a6ae lrc: 2/0,0 mode: --/PR res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166752.065004:0:23942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cf3dc6e00/0x2f180c4effb0a6ae lrc: 0/0,0 mode: --/PR res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166752.065205:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c5f20b66-016a-4159-9d62-071c0da3ef0b+9:2416:x1847765439965952:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 4820us (4928us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1762166752.065213:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 425 00000100:00100000:0.0:1762166752.069251:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166752.069293:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439966080 00000100:00100000:2.0:1762166752.069302:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439966080 00000100:00100000:2.0:1762166752.069380:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 426 00000100:00100000:2.0:1762166752.069393:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c5f20b66-016a-4159-9d62-071c0da3ef0b+6:2418:x1847765439966080:12345-192.168.204.38@tcp:4:lfs.0 00002000:00010000:2.0:1762166752.069435:0:23942:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1762166752.069442:0:23942:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0a6b5 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166752.069453:0:23942:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166752.069454:0:23942:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166752.069459:0:23942:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0a6b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166752.069508:0:23942:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0a6b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1762166752.075068:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869312 is committed 00000001:00080000:0.0:1762166752.075090:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869311 is committed 00000001:00080000:0.0:1762166752.075097:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869309 is committed 00002000:00010000:2.0:1762166752.075181:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x11:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:2.0:1762166752.075186:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x11:0x0] updating lvb mtime from disk: 0 -> 1762166752 00002000:00010000:2.0:1762166752.075189:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x11:0x0] updating lvb ctime from disk: 0 -> 1762166752 00002000:00010000:2.0:1762166752.075191:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x11:0x0] updating lvb blocks from disk: 0 -> 2048 00010000:00010000:2.0:1762166752.075203:0:23942:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0a6b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166752.075213:0:23942:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0a6b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166752.075222:0:23942:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0a6b5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166752.075228:0:23942:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166752.075231:0:23942:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0a6b5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166752.075238:0:23942:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0a6b5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166752.075254:0:23942:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0a6b5 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166752.075261:0:23942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0a6b5 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166752.075358:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c5f20b66-016a-4159-9d62-071c0da3ef0b+6:2418:x1847765439966080:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 5964us (6111us total) trans 17179869312 rc 0/0 00000100:00100000:2.0:1762166752.075368:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 426 00000100:00100000:1.0:1762166752.079300:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166752.079361:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439966208 00000100:00100000:2.0:1762166752.079372:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439966208 00000100:00100000:2.0:1762166752.079462:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 427 00000100:00100000:2.0:1762166752.079472:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5589180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c5f20b66-016a-4159-9d62-071c0da3ef0b+9:2418:x1847765439966208:12345-192.168.204.38@tcp:4:lfs.0 00002000:00010000:2.0:1762166752.079543:0:23942:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1762166752.079551:0:23942:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0a6bc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166752.079565:0:23942:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166752.079568:0:23942:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166752.079573:0:23942:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0a6bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166752.079586:0:23942:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0a6bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1762166752.086268:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836628 is committed 00000001:00080000:1.0:1762166752.086284:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836627 is committed 00000001:00080000:1.0:1762166752.086301:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836620 is committed 00002000:00010000:2.0:1762166752.086399:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x12:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:2.0:1762166752.086403:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x12:0x0] updating lvb mtime from disk: 0 -> 1762166752 00002000:00010000:2.0:1762166752.086404:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x12:0x0] updating lvb ctime from disk: 0 -> 1762166752 00002000:00010000:2.0:1762166752.086406:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x12:0x0] updating lvb blocks from disk: 0 -> 2048 00010000:00010000:2.0:1762166752.086416:0:23942:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0a6bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166752.086423:0:23942:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0a6bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166752.086435:0:23942:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0a6bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166752.086439:0:23942:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1200 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166752.086443:0:23942:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0a6bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166752.086448:0:23942:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0a6bc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166752.086461:0:23942:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0a6bc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166752.086465:0:23942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0a6bc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166752.086558:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5589180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c5f20b66-016a-4159-9d62-071c0da3ef0b+6:2418:x1847765439966208:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 7085us (7268us total) trans 21474836628 rc 0/0 00000100:00100000:2.0:1762166752.086565:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 427 00000100:00100000:0.0:1762166752.096669:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166752.096736:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439966464 00000100:00100000:2.0:1762166752.096748:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439966464 00000100:00100000:2.0:1762166752.096804:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2424 00000100:00100000:2.0:1762166752.096828:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+12:36478:x1847765439966464:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:2.0:1762166752.096884:0:6496:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166752.096909:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0a6a0 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7440 expref: 12 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166752.096956:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2:0x0].0x0 (ffff945bc477fb00) 00010000:00010000:2.0:1762166752.096960:0:6496:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166752.097134:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1200/0x2f180c4effb0a6c3 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166752.097147:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1200/0x2f180c4effb0a6c3 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166752.097163:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1200/0x2f180c4effb0a6c3 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000001:00080000:2.0:1762166752.097205:0:6496:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294967361 00000004:00010000:2.0:1762166752.097227:0:6496:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000006660b251 reply state 00000000c7869bde transno 4294967362 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1200/0x2f180c4effb0a6c3 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166752.097237:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1200/0x2f180c4effb0a6c3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166752.097243:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2:0x0].0x0 (ffff945bc477fb00) 00010000:00010000:2.0:1762166752.097246:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166752.097248:0:6496:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166752.097319:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+14:36478:x1847765439966464:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 506us (661us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1762166752.097326:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2424 00000020:00080000:2.0:1762166752.097331:0:6496:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1762166752.098593:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166752.098627:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439966592 00000100:00100000:2.0:1762166752.098632:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439966592 00000100:00100000:2.0:1762166752.098663:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 860 00000100:00100000:2.0:1762166752.098668:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+6:36478:x1847765439966592:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166752.098679:0:8382:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166752.098699:0:8382:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0a6ca lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b744e expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166752.098723:0:8382:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x11:0x0] initial LVB size: 1048576, mtime: 0x690887e0, atime: 0x0, ctime: 0x690887e0, blocks: 0x800 00010000:00010000:2.0:1762166752.098737:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166752.098739:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166752.098744:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0a6ca lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b744e expref: 7 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166752.098754:0:8382:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0a6ca lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b744e expref: 7 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166752.098761:0:8382:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0000, rc 0) 00000100:00100000:2.0:1762166752.098788:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+7:36478:x1847765439966592:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 120us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166752.098793:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 860 00000100:00100000:3.0:1762166752.100075:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166752.100125:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439966720 00000100:00100000:2.0:1762166752.100131:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439966720 00002000:00010000:2.0:1762166752.100156:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/17 (1048576->18446744073709551615) 00002000:00100000:2.0:1762166752.100160:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4530e00 with x1847765439966720 ext(1048576->18446744073709551615) 00002000:00010000:2.0:1762166752.100168:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4530e00. 00000100:00100000:2.0:1762166752.100195:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 428 00000100:00100000:2.0:1762166752.100201:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4530e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c5f20b66-016a-4159-9d62-071c0da3ef0b+7:2418:x1847765439966720:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:2.0:1762166752.100309:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x11:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1762166752.100312:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x11:0x0] updating lvb mtime from disk: 1762166752 -> 1762166752 00002000:00010000:2.0:1762166752.100314:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x11:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1762166752.100316:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x11:0x0] updating lvb ctime from disk: 1762166752 -> 1762166752 00002000:00010000:2.0:1762166752.100327:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x11:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:2.0:1762166752.100368:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4530e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c5f20b66-016a-4159-9d62-071c0da3ef0b+8:2418:x1847765439966720:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 167us (296us total) trans 17179869313 rc 0/0 00000100:00100000:2.0:1762166752.100376:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 428 00002000:00010000:2.0:1762166752.100379:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/17 (1048576->18446744073709551615) 00002000:00100000:2.0:1762166752.100381:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4530e00 with x1847765439966720 ext(1048576->18446744073709551615) 00002000:00010000:2.0:1762166752.100386:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4530e00. 00000100:00100000:0.0:1762166752.101592:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166752.101663:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439966848 00000100:00100000:2.0:1762166752.101669:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439966848 00000100:00100000:2.0:1762166752.101712:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2425 00000100:00100000:2.0:1762166752.101720:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+14:36478:x1847765439966848:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166752.101739:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166752.101757:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb0a6d1 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7455 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166752.101836:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0a6d8 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166752.101850:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0a6d8 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166752.101866:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0a6d8 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000004:00200000:2.0:1762166752.101892:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000403:0x2:0x0]: returning size 1048576 00000004:00200000:2.0:1762166752.101896:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166752.101912:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0a6d8 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166752.101935:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb0a6d1 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7455 expref: 16 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166752.101963:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0a6d8 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7455 expref: 15 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166752.101972:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2:0x0].0x0 (ffff945bc477fb00) 00010000:00010000:2.0:1762166752.101976:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166752.101979:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0600, rc 0) 00000100:00100000:2.0:1762166752.102019:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+15:36478:x1847765439966848:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 299us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166752.102026:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2425 00000100:00100000:1.0:1762166752.103611:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166752.103662:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439967104 00000100:00100000:2.0:1762166752.103668:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439967104 00000100:00100000:2.0:1762166752.103713:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2426 00000100:00100000:2.0:1762166752.103723:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5589500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+15:36478:x1847765439967104:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:2.0:1762166752.103764:0:6496:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166752.103783:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0a6d8 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7455 expref: 15 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166752.103798:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2:0x0].0x0 (ffff945bc477fb00) 00010000:00010000:2.0:1762166752.103802:0:6496:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166752.103949:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4a00/0x2f180c4effb0a6df lrc: 3/0,1 mode: --/PW res: [0x240000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166752.103961:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4a00/0x2f180c4effb0a6df lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166752.103970:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4a00/0x2f180c4effb0a6df lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000001:00080000:2.0:1762166752.104028:0:6496:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294967363 00000004:00010000:2.0:1762166752.104052:0:6496:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000009d91795d reply state 00000000aeab55de transno 4294967364 ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4a00/0x2f180c4effb0a6df lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166752.104064:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4a00/0x2f180c4effb0a6df lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166752.104071:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2:0x0].0x0 (ffff945bc477fb00) 00010000:00010000:2.0:1762166752.104073:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166752.104076:0:6496:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166752.104167:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5589500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+17:36478:x1847765439967104:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 446us (560us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1762166752.104175:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2426 00000020:00080000:2.0:1762166752.104181:0:6496:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762166752.105423:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166752.105468:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439967232 00000100:00100000:2.0:1762166752.105473:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439967232 00000100:00100000:2.0:1762166752.105535:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 861 00000100:00100000:2.0:1762166752.105545:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4530a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+6:36478:x1847765439967232:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166752.105559:0:8382:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166752.105576:0:8382:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cf3cb4400/0x2f180c4effb0a6e6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b745c expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166752.105597:0:8382:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 1048576, mtime: 0x690887e0, atime: 0x0, ctime: 0x690887e0, blocks: 0x800 00010000:00010000:2.0:1762166752.105616:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166752.105618:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166752.105624:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cf3cb4400/0x2f180c4effb0a6e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b745c expref: 7 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166752.105635:0:8382:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945cf3cb4400/0x2f180c4effb0a6e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b745c expref: 7 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166752.105650:0:8382:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cb4400, rc 0) 00000100:00100000:2.0:1762166752.105685:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4530a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+7:36478:x1847765439967232:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 142us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166752.105691:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 861 00000100:00100000:0.0:1762166752.106847:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166752.106925:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439967360 00000100:00100000:2.0:1762166752.106931:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439967360 00002000:00010000:2.0:1762166752.106956:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/18 (1048576->18446744073709551615) 00002000:00100000:2.0:1762166752.106961:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc47b4a80 with x1847765439967360 ext(1048576->18446744073709551615) 00002000:00010000:2.0:1762166752.106969:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc47b4a80. 00000100:00100000:2.0:1762166752.106996:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 429 00000100:00100000:2.0:1762166752.107004:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c5f20b66-016a-4159-9d62-071c0da3ef0b+7:2419:x1847765439967360:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:2.0:1762166752.107145:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x12:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1762166752.107148:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x12:0x0] updating lvb mtime from disk: 1762166752 -> 1762166752 00002000:00010000:2.0:1762166752.107151:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x12:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1762166752.107153:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x12:0x0] updating lvb ctime from disk: 1762166752 -> 1762166752 00002000:00010000:2.0:1762166752.107155:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x12:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:2.0:1762166752.107195:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c5f20b66-016a-4159-9d62-071c0da3ef0b+8:2419:x1847765439967360:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 192us (351us total) trans 21474836629 rc 0/0 00000100:00100000:2.0:1762166752.107202:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 429 00002000:00010000:2.0:1762166752.107205:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/18 (1048576->18446744073709551615) 00002000:00100000:2.0:1762166752.107207:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc47b4a80 with x1847765439967360 ext(1048576->18446744073709551615) 00002000:00010000:2.0:1762166752.107211:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc47b4a80. 00000100:00100000:1.0:1762166752.108607:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166752.108656:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439967616 00000100:00100000:2.0:1762166752.108662:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439967616 00000100:00100000:2.0:1762166752.108715:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2427 00000100:00100000:2.0:1762166752.108724:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5588e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+17:36478:x1847765439967616:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:2.0:1762166752.108827:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5400/0x2f180c4effb0a6ed lrc: 3/0,1 mode: --/PW res: [0x240000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166752.108845:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5400/0x2f180c4effb0a6ed lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166752.108861:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5400/0x2f180c4effb0a6ed lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000004:00010000:2.0:1762166752.108956:0:6496:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000000da784d6 reply state 000000001d9917be transno 4294967365 ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5400/0x2f180c4effb0a6ed lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166752.108969:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5400/0x2f180c4effb0a6ed lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166752.108976:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2:0x0].0x0 (ffff945bc477fb00) 00010000:00010000:2.0:1762166752.108979:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166752.108982:0:6496:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166752.109065:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5588e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+19:36478:x1847765439967616:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 336us (454us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1762166752.109076:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2427 00000100:00100000:1.0:1762166752.110862:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166752.111060:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439967744 00000100:00100000:2.0:1762166752.111067:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439967744 00000100:00100000:2.0:1762166752.111126:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 862 00000100:00100000:2.0:1762166752.111140:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5589880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+8:2419:x1847765439967744:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:2.0:1762166752.111271:0:8382:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x11:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1762166752.111275:0:8382:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x11:0x0] updating lvb mtime from disk: 1762166752 -> 1762166752 00002000:00010000:2.0:1762166752.111277:0:8382:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x11:0x0] updating lvb atime from disk: 0 -> 1762166752 00002000:00010000:2.0:1762166752.111290:0:8382:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x11:0x0] updating lvb ctime from disk: 1762166752 -> 1762166752 00002000:00010000:2.0:1762166752.111293:0:8382:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x11:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:2.0:1762166752.111345:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5589880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+9:2419:x1847765439967744:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 210us (487us total) trans 21474836630 rc 0/0 00000100:00100000:2.0:1762166752.111353:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 862 00000100:00100000:0.0:1762166752.113353:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166752.113427:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439968000 00000100:00100000:2.0:1762166752.113435:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439968000 00000100:00100000:2.0:1762166752.113507:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 696 00000100:00100000:2.0:1762166752.113518:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+19:36478:x1847765439968000:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:2.0:1762166752.113574:0:6498:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x240000403:0x2:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb0a676 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x2:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7432 expref: 19 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166752.113620:0:6498:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0a6f4 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 00010000:00010000:2.0:1762166752.113632:0:6498:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0a692 lrc: 2/0,0 mode: CR/CR res: [0x240000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7439 expref: 19 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166752.113642:0:6498:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0a6f4 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT1 00010000:00010000:2.0:1762166752.113678:0:6498:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0a692 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7439 expref: 19 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166752.113691:0:6498:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0a692 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7439 expref: 19 pid: 6496 timeout: 471 lvb_type: 0 00000100:00100000:2.0:1762166752.113708:0:6498:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bba300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001_UUID:6498:1847765446768512:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166752.113799:0:6498:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc37313c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166752.115542:0:6498:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bba300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001_UUID:6498:1847765446768512:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166752.115577:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:2.0:1762166752.115591:0:6498:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0a6f4 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT1 00000100:00100000:3.0:1762166752.115663:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439968128 00000100:00100000:3.0:1762166752.115672:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439968128 00010000:00010000:3.0:1762166752.115704:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0a692 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7439 expref: 20 pid: 6496 timeout: 471 lvb_type: 0 00000100:00100000:3.0:1762166752.115743:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 563 00000100:00100000:3.0:1762166752.115751:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+20:2418:x1847765439968128:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166752.115763:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166752.115768:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0a692 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7439 expref: 20 pid: 6496 timeout: 471 lvb_type: 0 00010000:00010000:3.0:1762166752.115779:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0a692 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7439 expref: 20 pid: 6496 timeout: 471 lvb_type: 0 00010000:00010000:3.0:1762166752.115794:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0a692 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7439 expref: 20 pid: 6496 timeout: 471 lvb_type: 0 00010000:00010000:3.0:1762166752.115813:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2:0x0].0x0 (ffff945bc477fb00) 00010000:00010000:3.0:1762166752.115818:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0a6f4 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT1 00010000:00010000:3.0:1762166752.115827:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0a6f4 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT1 00010000:00010000:3.0:1762166752.115835:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0a6f4 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT1 00010000:00010000:3.0:1762166752.115888:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166752.115938:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+19:2418:x1847765439968128:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 186us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166752.115953:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 563 00010000:00010000:2.0:1762166752.115963:0:6498:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0a6f4 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT1 00010000:00010000:2.0:1762166752.115974:0:6498:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0a6f4 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT1 00000040:00080000:2.0:1762166752.116321:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8696 00000004:00080000:2.0:1762166752.116332:0:6498:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 371264853650ns, next at 0ns, rc = 0 00000040:00080000:2.0:1762166752.116396:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8584 00000004:00080000:2.0:1762166752.116403:0:6498:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 371264925114ns, next at 217073438938ns, rc = 0 00000040:00080000:2.0:1762166752.116442:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 88 off8784 00000004:00080000:2.0:1762166752.116448:0:6498:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 371264970518ns, next at 0ns, rc = 0 00000001:00080000:3.0:1762166752.119655:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967366 is committed 00000004:00080000:3.0:1762166752.119668:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 7 committed 00000004:00080000:3.0:1762166752.119685:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 5 committed 00000004:00080000:3.0:1762166752.119698:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 6 committed 00000004:00010000:3.0:1762166752.119783:0:6498:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000005873d837 reply state 00000000081647a6 transno 4294967366 ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0a6f4 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT1 00000100:00100000:2.0:1762166752.119816:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446768640:0@lo:2:osp-syn-1-1.0 00010000:00010000:3.0:1762166752.119819:0:6498:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0a6f4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT1 00010000:00010000:3.0:1762166752.119834:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2:0x0].0x0 (ffff945bc477fb00) 00000100:00100000:1.0:1762166752.119836:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5588380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446768896:0@lo:2:osp-syn-0-1.0 00010000:00010000:3.0:1762166752.119837:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1762166752.119841:0:6498:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1762166752.119849:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2:0x0].0x0 (ffff945bc477fb00) 00010000:00010000:3.0:1762166752.119852:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166752.119858:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb0a676 lrc: 0/0,0 mode: --/PW res: [0x240000403:0x2:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7432 expref: 13 pid: 6496 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166752.119913:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1762166752.119922:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1200/0x2f180c4effb0a6c3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166752.119931:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1200/0x2f180c4effb0a6c3 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166752.119937:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1200/0x2f180c4effb0a6c3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166752.119943:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166752.119948:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1200/0x2f180c4effb0a6c3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00000100:00100000:2.0:1762166752.119957:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1762166752.119958:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1200/0x2f180c4effb0a6c3 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166752.119972:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2:0x0].0x0 (ffff945bc477fb00) 00010000:00010000:0.0:1762166752.119975:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00080000:3.0:1762166752.119976:0:6498:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1762166752.119992:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5589c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446768768:0@lo:2:osp-syn-0-1.0 00010000:00010000:0.0:1762166752.119993:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1200/0x2f180c4effb0a6c3 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00000100:00100000:3.0:1762166752.119995:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+13:36478:x1847765439968000:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 6479us (6645us total) trans 4294967366 rc 0/0 00010000:00010000:0.0:1762166752.120009:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1200/0x2f180c4effb0a6c3 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00000100:00100000:3.0:1762166752.120017:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 696 00000100:00100000:2.0:1762166752.120020:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446768896 00000100:00100000:1.0:1762166752.120027:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1762166752.120028:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4a00/0x2f180c4effb0a6df lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00000100:00100000:2.0:1762166752.120030:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446768896 00010000:00010000:0.0:1762166752.120037:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4a00/0x2f180c4effb0a6df lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166752.120044:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4a00/0x2f180c4effb0a6df lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166752.120049:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb4a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166752.120052:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4a00/0x2f180c4effb0a6df lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166752.120058:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4a00/0x2f180c4effb0a6df lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166752.120067:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2:0x0].0x0 (ffff945bc477fb00) 00010000:00010000:0.0:1762166752.120070:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166752.120074:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0a6f4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT1 00010000:00010000:0.0:1762166752.120074:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4a00/0x2f180c4effb0a6df lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00000100:00100000:2.0:1762166752.120078:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446768640 00000100:00100000:2.0:1762166752.120098:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446768640 00010000:00010000:0.0:1762166752.120100:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4a00/0x2f180c4effb0a6df lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166752.120101:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0a6f4 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT1 00010000:00010000:3.0:1762166752.120118:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0a6f4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT1 00010000:00010000:0.0:1762166752.120121:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5400/0x2f180c4effb0a6ed lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00000100:00100000:2.0:1762166752.120125:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446768768 00000100:00100000:2.0:1762166752.120130:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446768768 00010000:00010000:0.0:1762166752.120133:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5400/0x2f180c4effb0a6ed lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166752.120150:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5400/0x2f180c4effb0a6ed lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166752.120151:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb4200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166752.120157:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0a6f4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT1 00000100:00100000:2.0:1762166752.120159:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 863 00010000:00010000:0.0:1762166752.120164:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb5400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166752.120170:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5400/0x2f180c4effb0a6ed lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166752.120173:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0a6f4 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT1 00000100:00100000:2.0:1762166752.120173:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3633:x1847765446768896:12345-0@lo:2:osp-syn-0-1.0 00010000:00010000:0.0:1762166752.120181:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5400/0x2f180c4effb0a6ed lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166752.120197:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2:0x0].0x0 (ffff945bc477fb00) 00010000:00010000:3.0:1762166752.120202:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166752.120207:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0a6f4 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT1 00010000:00010000:0.0:1762166752.120207:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2:0x0].0x0 (ffff945bc477fb00) 00010000:00010000:0.0:1762166752.120213:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166752.120218:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5400/0x2f180c4effb0a6ed lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166752.120226:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5400/0x2f180c4effb0a6ed lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00000100:00100000:0.0:1762166752.120254:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 864 00000100:00100000:0.0:1762166752.120264:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1847765446768640:12345-0@lo:2:osp-syn-1-1.0 00010000:00010000:3.0:1762166752.120273:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0a6f4 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT1 00000100:00100000:3.0:1762166752.120304:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 865 00000100:00100000:3.0:1762166752.120325:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+7:3635:x1847765446768768:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:2.0:1762166752.120328:0:8382:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x12:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1762166752.120333:0:8382:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x12:0x0] updating lvb mtime from disk: 1762166752 -> 1762166752 00002000:00010000:2.0:1762166752.120336:0:8382:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x12:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1762166752.120338:0:8382:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x12:0x0] updating lvb ctime from disk: 1762166752 -> 1762166752 00002000:00010000:2.0:1762166752.120350:0:8382:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x12:0x0] updating lvb blocks from disk: 2048 -> 2048 00002000:00010000:0.0:1762166752.120377:0:8380:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x11:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1762166752.120386:0:8380:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x11:0x0] updating lvb mtime from disk: 1762166752 -> 1762166752 00002000:00010000:0.0:1762166752.120389:0:8380:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x11:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1762166752.120392:0:8380:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x11:0x0] updating lvb ctime from disk: 1762166752 -> 1762166752 00002000:00010000:0.0:1762166752.120394:0:8380:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x11:0x0] updating lvb blocks from disk: 2048 -> 2048 00002000:00010000:3.0:1762166752.120398:0:9168:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x11:0x0] updating lvb size from disk: 1048576 -> 1048576 00000100:00100000:2.0:1762166752.120399:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+8:3633:x1847765446768896:12345-0@lo:2:osp-syn-0-1.0 Request processed in 228us (485us total) trans 21474836631 rc 0/0 00002000:00010000:3.0:1762166752.120405:0:9168:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x11:0x0] updating lvb mtime from disk: 1762166752 -> 1762166752 00000100:00100000:2.0:1762166752.120412:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 863 00002000:00010000:3.0:1762166752.120415:0:9168:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x11:0x0] updating lvb atime from disk: 1762166752 -> 1762166752 00002000:00010000:3.0:1762166752.120420:0:9168:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x11:0x0] updating lvb ctime from disk: 1762166752 -> 1762166752 00002000:00010000:3.0:1762166752.120422:0:9168:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x11:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1762166752.120442:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3636:x1847765446768640:12345-0@lo:2:osp-syn-1-1.0 Request processed in 179us (487us total) trans 17179869314 rc 0/0 00000100:00100000:0.0:1762166752.120452:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 864 00000100:00100000:3.0:1762166752.120469:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+7:3635:x1847765446768768:12345-0@lo:2:osp-syn-0-1.0 Request processed in 156us (443us total) trans 21474836632 rc 0/0 00000100:00100000:1.0:1762166752.120470:0:3633:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 21474836627 gen 2 00000100:00100000:3.0:1762166752.120503:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 865 00000100:00100000:2.0:1762166752.120522:0:3636:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179869311 gen 2 00000004:00080000:1.0:1762166752.120527:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5ef4700, transno 21474836622 00000004:00080000:2.0:1762166752.120528:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5bbb480, transno 17179869310 00000004:00080000:1.0:1762166752.120541:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5ef6a00, transno 21474836623 00000004:00080000:2.0:1762166752.120542:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1e6f800, transno 17179869311 00000004:00080000:1.0:1762166752.120548:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5ef7800, transno 21474836626 00000100:00100000:2.0:1762166752.120554:0:3636:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff945bc5bba300 x1847765446768640/t17179869314(17179869314) o2->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 440/432 e 0 to 0 dl 1762166768 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1762166752.120561:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5ef5880, transno 21474836627 00000100:00100000:1.0:1762166752.120568:0:3633:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff945bc5588380 x1847765446768896/t21474836631(21474836631) o2->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 440/432 e 0 to 0 dl 1762166768 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1762166752.120572:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5bba300/2, rc 0, transno 17179869314 00000004:00080000:1.0:1762166752.120575:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5588380/2, rc 0, transno 21474836631 00000100:00100000:2.0:1762166752.120581:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446768640:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1762166752.120582:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5588380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446768896:0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1762166752.120661:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5589c00/2, rc 0, transno 21474836632 00000100:00100000:0.0:1762166752.120673:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5589c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446768768:0@lo:2:osp-syn-0-1.0 00000004:00080000:2.0:1762166752.120715:0:9158:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0001: 0 changes, 2 in progress, 0 in flight, 4 done 00000100:00100000:0.0:1762166752.122177:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166752.122269:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439968256 00000100:00100000:2.0:1762166752.122277:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439968256 00000100:00100000:2.0:1762166752.122333:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2428 00000100:00100000:2.0:1762166752.122343:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+9:36478:x1847765439968256:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166752.122368:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166752.122388:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4600/0x2f180c4effb0a6fb lrc: 2/0,0 mode: --/CR res: [0x240000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7463 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166752.122436:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4600/0x2f180c4effb0a6fb lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7463 expref: 10 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166752.122451:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4600/0x2f180c4effb0a6fb lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7463 expref: 10 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166752.122467:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2:0x0].0x0 (ffff945bc477fb00) 00010000:00010000:2.0:1762166752.122510:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166752.122515:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cb4600, rc 0) 00000100:00100000:2.0:1762166752.122561:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+10:36478:x1847765439968256:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 220us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166752.122569:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2428 00000100:00100000:1.0:1762166752.124380:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166752.124423:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439968512 00000100:00100000:3.0:1762166752.124443:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439968512 00000100:00100000:3.0:1762166752.124517:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 697 00000100:00100000:3.0:1762166752.124529:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+10:36478:x1847765439968512:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1762166752.124736:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+11:36478:x1847765439968512:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 209us (360us total) trans 4294967367 rc 0/0 00000100:00100000:3.0:1762166752.124744:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 697 00000100:00100000:1.0:1762166752.135016:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166752.135104:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439968768 00000100:00100000:2.0:1762166752.135115:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439968768 00000100:00100000:2.0:1762166752.135174:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2429 00000100:00100000:2.0:1762166752.135188:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5588a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+11:36480:x1847765439968768:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166752.135214:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166752.135235:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0a702 lrc: 2/0,0 mode: --/CR res: [0x240000400:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b746a expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166752.135304:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5c00/0x2f180c4effb0a709 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166752.135317:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5c00/0x2f180c4effb0a709 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166752.135328:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5c00/0x2f180c4effb0a709 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166752.135341:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5800/0x2f180c4effb0a710 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166752.135348:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5800/0x2f180c4effb0a710 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166752.135354:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5800/0x2f180c4effb0a710 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166752.135429:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5c00/0x2f180c4effb0a709 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166752.135449:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5c00/0x2f180c4effb0a709 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166752.135456:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5c00/0x2f180c4effb0a709 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166752.135463:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5c00/0x2f180c4effb0a709 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166752.135468:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb5c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166752.135472:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5c00/0x2f180c4effb0a709 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166752.135506:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5c00/0x2f180c4effb0a709 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166752.135518:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x4:0x0].0x0 (ffff945bc477f500) 00010000:00010000:2.0:1762166752.135522:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166752.135526:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5c00/0x2f180c4effb0a709 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166752.135533:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5c00/0x2f180c4effb0a709 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166752.135546:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5800/0x2f180c4effb0a710 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166752.135553:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5800/0x2f180c4effb0a710 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166752.135559:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5800/0x2f180c4effb0a710 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166752.135564:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb5800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166752.135573:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5800/0x2f180c4effb0a710 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166752.135579:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5800/0x2f180c4effb0a710 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166752.135587:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x4:0x0].0x8f0a8bfd (ffff945bc477fc00) 00010000:00010000:2.0:1762166752.135590:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166752.135593:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5800/0x2f180c4effb0a710 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166752.135599:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5800/0x2f180c4effb0a710 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166752.135630:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0a702 lrc: 1/0,0 mode: --/CR res: [0x240000400:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b746a expref: 12 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166752.135640:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x4:0x0].0x0 (ffff945bc477f500) 00010000:00010000:2.0:1762166752.135642:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1762166752.135646:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0a702 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b746a expref: 12 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166752.135657:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cb5000, rc 0) 00000100:00100000:2.0:1762166752.135715:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5588a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+11:36480:x1847765439968768:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 531us (708us total) trans 0 rc 301/301 00000100:00100000:2.0:1762166752.135723:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2429 00000100:00100000:0.0:1762166752.137198:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166752.137264:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439968896 00000100:00100000:2.0:1762166752.137276:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439968896 00000100:00100000:2.0:1762166752.137344:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2430 00000100:00100000:2.0:1762166752.137355:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+11:36480:x1847765439968896:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:2.0:1762166752.137461:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4000/0x2f180c4effb0a717 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166752.137508:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4000/0x2f180c4effb0a717 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166752.137522:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4000/0x2f180c4effb0a717 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166752.137535:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4800/0x2f180c4effb0a71e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166752.137540:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4800/0x2f180c4effb0a71e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166752.137543:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4800/0x2f180c4effb0a71e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166752.137633:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0a725 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166752.137643:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0a725 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166752.137650:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0a725 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000004:00200000:2.0:1762166752.137705:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000403:0x2:0x0]: returning size 1048576 00000004:00200000:2.0:1762166752.137711:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166752.137725:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0a725 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166752.137739:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4000/0x2f180c4effb0a717 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166752.137756:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4000/0x2f180c4effb0a717 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166752.137763:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4000/0x2f180c4effb0a717 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166752.137770:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4000/0x2f180c4effb0a717 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166752.137776:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb4000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166752.137780:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4000/0x2f180c4effb0a717 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166752.137788:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4000/0x2f180c4effb0a717 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166752.137800:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x4:0x0].0x0 (ffff945bc477f800) 00010000:00010000:2.0:1762166752.137804:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166752.137809:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4000/0x2f180c4effb0a717 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166752.137815:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4000/0x2f180c4effb0a717 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166752.137836:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4800/0x2f180c4effb0a71e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166752.137842:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4800/0x2f180c4effb0a71e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166752.137847:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4800/0x2f180c4effb0a71e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166752.137852:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb4800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166752.137861:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4800/0x2f180c4effb0a71e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166752.137866:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4800/0x2f180c4effb0a71e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166752.137874:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x4:0x0].0x8f0a8bfd (ffff945bc477f600) 00010000:00010000:2.0:1762166752.137877:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166752.137880:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4800/0x2f180c4effb0a71e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166752.137885:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4800/0x2f180c4effb0a71e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166752.137897:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0a725 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166752.137902:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0a725 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166752.137907:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0a725 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166752.137912:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb5a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166752.137915:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0a725 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166752.137919:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0a725 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166752.137926:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2:0x0].0x0 (ffff945bc477fb00) 00010000:00010000:2.0:1762166752.137928:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166752.137931:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0a725 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166752.137949:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0a725 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00000100:00100000:2.0:1762166752.138032:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+11:36480:x1847765439968896:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 678us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166752.138041:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2430 00010000:00010000:0.0:1762166753.042592:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166753.042633:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4533480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d5309af7-bf8a-40d1-8f22-842c4953c1ea:3634:1847765446769024:0@lo:400:kworker.0 00000100:00100000:0.0:1762166753.042633:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4532d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1847765446769152:0@lo:400:kworker.0 00000100:00100000:2.0:1762166753.042707:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4531f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446769280:0@lo:400:kworker.0 00000100:00100000:1.0:1762166753.042709:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166753.042716:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166753.042749:0:6487:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446769024 00000100:00100000:3.0:1762166753.042757:0:6487:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446769024 00000100:00100000:2.0:1762166753.042778:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166753.042789:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4530380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446769536:0@lo:400:kworker.0 00000100:00100000:0.0:1762166753.042789:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4531500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446769664:0@lo:400:kworker.0 00000100:00100000:2.0:1762166753.042808:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1e6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446769792:0@lo:400:kworker.0 00000100:00100000:3.0:1762166753.042810:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 557 00000100:00100000:3.0:1762166753.042825:0:6487:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7d17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5309af7-bf8a-40d1-8f22-842c4953c1ea+23:3634:x1847765446769024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166753.042835:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166753.042841:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166753.042856:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446769152 00000100:00100000:2.0:1762166753.042862:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446769152 00000100:00100000:1.0:1762166753.042869:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446770048:0@lo:400:kworker.0 00000100:00100000:0.0:1762166753.042879:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3635:1847765446770176:0@lo:400:kworker.0 00000100:00100000:3.0:1762166753.042880:0:6487:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7d17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5309af7-bf8a-40d1-8f22-842c4953c1ea+23:3634:x1847765446769024:12345-0@lo:400:kworker.0 Request processed in 57us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166753.042891:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 557 00000100:00100000:2.0:1762166753.042905:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1762166753.042906:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166753.042921:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1847765446769152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166753.042922:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166753.042936:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3634:1847765446770560:0@lo:400:kworker.0 00000100:00100000:3.0:1762166753.042943:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446770176 00000100:00100000:3.0:1762166753.042947:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446770176 00000100:00100000:1.0:1762166753.042976:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166753.042978:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446769280 00000100:00100000:0.0:1762166753.042985:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446769280 00000100:00100000:2.0:1762166753.042987:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1847765446769152:12345-0@lo:400:kworker.0 Request processed in 71us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166753.042991:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446770560 00000100:00100000:3.0:1762166753.042996:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446770560 00000100:00100000:2.0:1762166753.043000:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1762166753.043020:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4533480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d5309af7-bf8a-40d1-8f22-842c4953c1ea:3634:1847765446769024:0@lo:400:kworker.0 00000100:00100000:2.0:1762166753.043027:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1762166753.043027:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446769536 00000100:00100000:0.0:1762166753.043033:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446769536 00000100:00100000:3.0:1762166753.043039:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:2.0:1762166753.043041:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf7838380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1847765446770176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166753.043042:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1762166753.043051:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1847765446770560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166753.043055:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4531c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1847765446769408:0@lo:400:kworker.0 00000100:00100000:0.0:1762166753.043059:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 534 00000100:00100000:0.0:1762166753.043081:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3636:x1847765446769280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1762166753.043106:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf7838380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1847765446770176:12345-0@lo:400:kworker.0 Request processed in 69us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166753.043114:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1847765446770560:12345-0@lo:400:kworker.0 Request processed in 66us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166753.043120:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1762166753.043120:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166753.043131:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1762166753.043132:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3636:x1847765446769280:12345-0@lo:400:kworker.0 Request processed in 51us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166753.043141:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 534 00000100:00100000:2.0:1762166753.043144:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446769408 00000100:00100000:1.0:1762166753.043145:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446769920:0@lo:400:kworker.0 00000100:00100000:2.0:1762166753.043149:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446769408 00000100:00100000:0.0:1762166753.043163:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 535 00000100:00100000:0.0:1762166753.043173:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1847765446769536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166753.043176:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446769664 00000100:00100000:3.0:1762166753.043181:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446769664 00000100:00100000:1.0:1762166753.043181:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166753.043186:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1762166753.043198:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1847765446769408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166753.043210:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3634:1847765446770432:0@lo:400:kworker.0 00000100:00100000:3.0:1762166753.043214:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446770048 00000100:00100000:3.0:1762166753.043217:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446770048 00000100:00100000:0.0:1762166753.043218:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1847765446769536:12345-0@lo:400:kworker.0 Request processed in 45us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166753.043231:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 535 00000100:00100000:3.0:1762166753.043233:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446769920 00000100:00100000:3.0:1762166753.043236:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446769920 00000100:00080000:0.0:1762166753.043253:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1762166753.043259:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1847765446769408:12345-0@lo:400:kworker.0 Request processed in 63us (142us total) trans 0 rc 0/0 00000100:00080000:0.0:1762166753.043259:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1762166753.043263:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166753.043269:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00080000:0.0:1762166753.043272:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1762166753.043274:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00080000:0.0:1762166753.043278:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1762166753.043279:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf7838700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+7:3635:x1847765446769664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1762166753.043297:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446770432 00000100:00100000:1.0:1762166753.043302:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4530380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446769536:0@lo:400:kworker.0 00000100:00100000:2.0:1762166753.043304:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446770432 00000100:00100000:3.0:1762166753.043313:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf7838700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+7:3635:x1847765446769664:12345-0@lo:400:kworker.0 Request processed in 37us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166753.043319:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1762166753.043329:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3634:1847765446770560:0@lo:400:kworker.0 00000100:00100000:3.0:1762166753.043336:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1762166753.043344:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4531500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446769664:0@lo:400:kworker.0 00000100:00100000:3.0:1762166753.043347:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1847765446770048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1762166753.043352:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1762166753.043361:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4531c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1847765446769408:0@lo:400:kworker.0 00000100:00100000:2.0:1762166753.043367:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1847765446770432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166753.043370:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3635:1847765446770176:0@lo:400:kworker.0 00000100:00100000:3.0:1762166753.043383:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1847765446770048:12345-0@lo:400:kworker.0 Request processed in 40us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166753.043383:0:3634:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179869309 gen 2 00000004:00080000:1.0:1762166753.043391:0:3634:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1cd2d80, transno 17179869309 00000100:00100000:0.0:1762166753.043391:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4532d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1847765446769152:0@lo:400:kworker.0 00000100:00100000:3.0:1762166753.043392:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1762166753.043412:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446770048:0@lo:400:kworker.0 00000100:00100000:3.0:1762166753.043413:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1762166753.043420:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1847765446770432:12345-0@lo:400:kworker.0 Request processed in 56us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166753.043424:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3634:x1847765446769920:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1762166753.043429:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1762166753.043434:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1762166753.043444:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3634:1847765446770432:0@lo:400:kworker.0 00000100:00100000:3.0:1762166753.043466:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3634:x1847765446769920:12345-0@lo:400:kworker.0 Request processed in 43us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166753.043470:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446769920:0@lo:400:kworker.0 00000100:00100000:3.0:1762166753.043515:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1762166753.043515:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166753.043534:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446769792 00000100:00100000:0.0:1762166753.043538:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3636:1847765446770304:0@lo:400:kworker.0 00000100:00100000:3.0:1762166753.043539:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446769792 00000100:00100000:0.0:1762166753.043563:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1762166753.043580:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1762166753.043586:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1762166753.043595:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1847765446769792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166753.043599:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4531f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446769280:0@lo:400:kworker.0 00000100:00100000:0.0:1762166753.043630:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446770304 00000100:00100000:0.0:1762166753.043633:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446770304 00000100:00100000:3.0:1762166753.043652:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1847765446769792:12345-0@lo:400:kworker.0 Request processed in 57us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166753.043661:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1762166753.043677:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00080000:2.0:1762166753.043679:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1762166753.043687:0:3636:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836620 gen 2 00000100:00100000:0.0:1762166753.043688:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1847765446770304:12345-0@lo:400:kworker.0 00000004:00080000:1.0:1762166753.043696:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1e6c380, transno 21474836620 00000100:00100000:1.0:1762166753.043713:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1e6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446769792:0@lo:400:kworker.0 00000100:00100000:0.0:1762166753.043724:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1847765446770304:12345-0@lo:400:kworker.0 Request processed in 40us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166753.043731:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3636:1847765446770304:0@lo:400:kworker.0 00000100:00100000:0.0:1762166753.043732:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1762166753.857605:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166753.857649:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439969024 00000100:00100000:2.0:1762166753.857659:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439969024 00000100:00080000:1.0:1762166753.857700:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1762166753.857727:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2431 00000100:00100000:2.0:1762166753.857737:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+11:36903:x1847765439969024:12345-192.168.204.38@tcp:101:rm.0 00010000:00010000:2.0:1762166753.857755:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166753.857777:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4000/0x2f180c4effb0a72c lrc: 2/0,0 mode: --/CR res: [0x240000400:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7471 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166753.857836:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4800/0x2f180c4effb0a733 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166753.857856:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4800/0x2f180c4effb0a733 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166753.857869:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4800/0x2f180c4effb0a733 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166753.857880:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0a73a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166753.857892:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0a73a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166753.857899:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0a73a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166753.857961:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0a741 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166753.857984:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0a741 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166753.857991:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0a741 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT1 00000004:00200000:2.0:1762166753.858032:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000403:0x2:0x0]: returning size 1048576 00000004:00200000:2.0:1762166753.858042:0:7432:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166753.858074:0:7432:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0a741 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166753.858084:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0a741 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166753.858092:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4800/0x2f180c4effb0a733 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166753.858098:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4800/0x2f180c4effb0a733 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166753.858104:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4800/0x2f180c4effb0a733 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166753.858109:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4800/0x2f180c4effb0a733 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166753.858124:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb4800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166753.858129:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4800/0x2f180c4effb0a733 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166753.858137:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4800/0x2f180c4effb0a733 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166753.858150:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x4:0x0].0x0 (ffff945bc477f600) 00010000:00010000:2.0:1762166753.858153:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166753.858157:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4800/0x2f180c4effb0a733 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166753.858162:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4800/0x2f180c4effb0a733 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166753.858173:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0a73a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166753.858178:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0a73a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166753.858183:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0a73a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166753.858187:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb5a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166753.858189:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0a73a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166753.858194:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0a73a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166753.858200:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x4:0x0].0x8f0a8bfd (ffff945bc477f800) 00010000:00010000:2.0:1762166753.858203:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166753.858212:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0a73a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166753.858218:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0a73a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166753.858249:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4000/0x2f180c4effb0a72c lrc: 0/0,0 mode: --/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7471 expref: 13 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166753.858262:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0a741 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7471 expref: 12 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166753.858269:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2:0x0].0x0 (ffff945bc477fb00) 00010000:00010000:2.0:1762166753.858272:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166753.858274:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cb4200, rc 0) 00000100:00100000:2.0:1762166753.858331:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+12:36903:x1847765439969024:12345-192.168.204.38@tcp:101:rm.0 Request processed in 595us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166753.858339:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2431 00000100:00100000:3.0:1762166753.860058:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166753.860134:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439969280 00000100:00100000:2.0:1762166753.860141:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439969280 00000100:00100000:2.0:1762166753.860188:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2432 00000100:00100000:2.0:1762166753.860199:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+12:36903:x1847765439969280:12345-192.168.204.38@tcp:36:rm.0 00010000:00010000:2.0:1762166753.860237:0:7432:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1762166753.860254:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4600/0x2f180c4effb0a6fb lrc: 0/0,0 mode: --/CR res: [0x240000403:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7463 expref: 12 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166753.860277:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0a741 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7471 expref: 11 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166753.860291:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb0a5c7 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b73f3 expref: 10 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166753.860311:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2:0x0].0x0 (ffff945bc477fb00) 00010000:00010000:2.0:1762166753.860321:0:7432:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166753.860340:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5400/0x2f180c4effb0a748 lrc: 3/0,1 mode: --/CW res: [0x240000400:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166753.860350:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5400/0x2f180c4effb0a748 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166753.860358:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5400/0x2f180c4effb0a748 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166753.860371:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4a00/0x2f180c4effb0a74f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166753.860377:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4a00/0x2f180c4effb0a74f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166753.860384:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4a00/0x2f180c4effb0a74f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166753.860440:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0a756 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166753.860448:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0a756 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166753.860455:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0a756 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT1 00000040:00080000:2.0:1762166753.860700:0:7432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 64 off8848 00000004:00080000:2.0:1762166753.860710:0:7432:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 373009232069ns, next at 374009229348ns, rc = 0 00000040:00080000:2.0:1762166753.860737:0:7432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 64 off8648 00000004:00080000:2.0:1762166753.860753:0:7432:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 373009274712ns, next at 374009272218ns, rc = 0 00000040:00080000:2.0:1762166753.860767:0:7432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].9, 64 off8912 00010000:00010000:2.0:1762166753.860824:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5800/0x2f180c4effb0a75d lrc: 3/0,1 mode: --/PW res: [0x240000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166753.860833:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5800/0x2f180c4effb0a75d lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166753.860841:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5800/0x2f180c4effb0a75d lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166753.860847:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5800/0x2f180c4effb0a75d lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166753.860854:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5800/0x2f180c4effb0a75d lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166753.860859:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5800/0x2f180c4effb0a75d lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166753.860883:0:7432:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166753.860896:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0a756 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166753.860902:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0a756 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166753.860908:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0a756 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166753.860912:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb5000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166753.860917:0:6482:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166753.860921:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0a756 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT1 00010000:00010000:3.0:1762166753.860926:0:6482:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5800/0x2f180c4effb0a75d lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166753.860930:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0a756 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT1 00010000:00010000:3.0:1762166753.860953:0:6482:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb5800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166753.860953:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2:0x0].0x0 (ffff945bc477fe00) 00010000:00010000:2.0:1762166753.860959:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1762166753.860963:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0a756 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT1 00010000:00010000:3.0:1762166753.860966:0:6482:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5800/0x2f180c4effb0a75d lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166753.860969:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0a756 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT1 00010000:00010000:3.0:1762166753.860987:0:6482:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5800/0x2f180c4effb0a75d lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 7432 initiator: MDT1 00010000:00010000:3.0:1762166753.861000:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2:0x0].0x0 (ffff945bc477fe00) 00010000:00010000:3.0:1762166753.861003:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1762166753.861007:0:6482:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5800/0x2f180c4effb0a75d lrc: 1/0,0 mode: --/PW res: [0x240000403:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7432 initiator: MDT1 00010000:00010000:3.0:1762166753.861013:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5800/0x2f180c4effb0a75d lrc: 0/0,0 mode: --/PW res: [0x240000403:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7432 initiator: MDT1 00010000:00010000:3.0:1762166753.861033:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166753.861045:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166753.861061:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166753.861119:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5400/0x2f180c4effb0a748 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166753.861127:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5400/0x2f180c4effb0a748 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166753.861133:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5400/0x2f180c4effb0a748 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166753.861139:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5400/0x2f180c4effb0a748 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166753.861144:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb5400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166753.861147:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5400/0x2f180c4effb0a748 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166753.861152:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5400/0x2f180c4effb0a748 lrc: 5/0,0 mode: CW/CW res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166753.861162:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x4:0x0].0x0 (ffff945bc477f500) 00010000:00010000:2.0:1762166753.861165:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166753.861168:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5400/0x2f180c4effb0a748 lrc: 3/0,0 mode: --/CW res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166753.861173:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5400/0x2f180c4effb0a748 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT1 00000004:00010000:2.0:1762166753.861192:0:7432:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000535ece3b reply state 000000000326cc3d transno 4294967368 ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4a00/0x2f180c4effb0a74f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166753.861203:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4a00/0x2f180c4effb0a74f lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166753.861210:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x4:0x0].0x8f0a8bfd (ffff945bc477fc00) 00010000:00010000:2.0:1762166753.861212:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166753.861214:0:7432:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166753.861275:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+11:36903:x1847765439969280:12345-192.168.204.38@tcp:36:rm.0 Request processed in 1078us (1272us total) trans 4294967368 rc 0/0 00000100:00100000:2.0:1762166753.861282:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2432 00010000:00010000:3.0:1762166754.066707:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1762166754.420251:0:29692:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-flr test 44a: lfs mirror split check =========== 05:45:54 (1762166754) 00000100:00100000:3.0:1762166754.449520:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166754.449589:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439969408 00000100:00100000:1.0:1762166754.449606:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439969408 00000100:00080000:2.0:1762166754.449665:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1762166754.449689:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2433 00000100:00100000:1.0:1762166754.449699:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+8:37048:x1847765439969408:12345-192.168.204.38@tcp:101:rm.0 00010000:00010000:1.0:1762166754.449725:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166754.449750:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0a764 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7478 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166754.449831:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a000/0x2f180c4effb0a76b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.449845:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a000/0x2f180c4effb0a76b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.449855:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a000/0x2f180c4effb0a76b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.449869:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0a772 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef8a66a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.449876:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0a772 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef8a66a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.449883:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0a772 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef8a66a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.449928:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a000/0x2f180c4effb0a76b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.449936:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a000/0x2f180c4effb0a76b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.449942:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a000/0x2f180c4effb0a76b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.449948:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a000/0x2f180c4effb0a76b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.449954:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786a000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166754.449959:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a000/0x2f180c4effb0a76b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.449973:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a000/0x2f180c4effb0a76b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.449985:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:1.0:1762166754.449989:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166754.449994:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a000/0x2f180c4effb0a76b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.450000:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a000/0x2f180c4effb0a76b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.450013:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0a772 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef8a66a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.450020:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0a772 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef8a66a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.450025:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0a772 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef8a66a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.450030:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786ba00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166754.450033:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0a772 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef8a66a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.450053:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0a772 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef8a66a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.450062:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef8a66a9 (ffff945cd0738800) 00010000:00010000:1.0:1762166754.450064:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166754.450068:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0a772 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef8a66a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.450074:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0a772 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef8a66a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.450112:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0a764 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7478 expref: 9 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166754.450120:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:1.0:1762166754.450122:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166754.450125:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0a764 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7478 expref: 9 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166754.450132:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf786a800, rc 0) 00000100:00100000:1.0:1762166754.450204:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+8:37048:x1847765439969408:12345-192.168.204.38@tcp:101:rm.0 Request processed in 506us (737us total) trans 0 rc 301/301 00000100:00100000:1.0:1762166754.450212:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2433 00000100:00100000:1.0:1762166754.456585:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166754.456639:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439969536 00000100:00100000:2.0:1762166754.456649:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439969536 00000100:00100000:2.0:1762166754.456701:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2434 00000100:00100000:2.0:1762166754.456712:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+8:37050:x1847765439969536:12345-192.168.204.38@tcp:101:rm.0 00010000:00010000:2.0:1762166754.456733:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166754.456752:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4200/0x2f180c4effb0a779 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b747f expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166754.456811:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4600/0x2f180c4effb0a780 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.456825:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4600/0x2f180c4effb0a780 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.456835:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4600/0x2f180c4effb0a780 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.456859:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4000/0x2f180c4effb0a787 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x67e404aa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.456866:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4000/0x2f180c4effb0a787 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67e404aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.456872:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4000/0x2f180c4effb0a787 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67e404aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.456909:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4600/0x2f180c4effb0a780 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.456916:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4600/0x2f180c4effb0a780 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.456921:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4600/0x2f180c4effb0a780 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.456928:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4600/0x2f180c4effb0a780 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.456933:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb4600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166754.456937:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4600/0x2f180c4effb0a780 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.456945:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4600/0x2f180c4effb0a780 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.456956:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:2.0:1762166754.456960:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166754.456964:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4600/0x2f180c4effb0a780 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.456969:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4600/0x2f180c4effb0a780 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.456986:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4000/0x2f180c4effb0a787 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67e404aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.456992:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4000/0x2f180c4effb0a787 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67e404aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.456998:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4000/0x2f180c4effb0a787 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67e404aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.457003:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb4000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166754.457007:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4000/0x2f180c4effb0a787 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67e404aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.457013:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4000/0x2f180c4effb0a787 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67e404aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.457020:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x67e404aa (ffff945bc477f500) 00010000:00010000:2.0:1762166754.457022:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166754.457025:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4000/0x2f180c4effb0a787 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x67e404aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.457031:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4000/0x2f180c4effb0a787 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x67e404aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.457084:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4200/0x2f180c4effb0a779 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b747f expref: 9 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166754.457096:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:2.0:1762166754.457098:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166754.457102:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4200/0x2f180c4effb0a779 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b747f expref: 9 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166754.457125:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cb4200, rc 0) 00000100:00100000:2.0:1762166754.457179:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+8:37050:x1847765439969536:12345-192.168.204.38@tcp:101:rm.0 Request processed in 469us (603us total) trans 0 rc 301/301 00000100:00100000:2.0:1762166754.457186:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2434 00000100:00100000:3.0:1762166754.471166:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166754.471202:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439969792 00000100:00100000:3.0:1762166754.471210:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439969792 00000100:00100000:3.0:1762166754.471256:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2435 00000100:00100000:3.0:1762166754.471267:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+8:37055:x1847765439969792:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:3.0:1762166754.471335:0:7432:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166754.471364:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1600/0x2f180c4effb0a4af lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b739f expref: 8 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166754.471383:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:3.0:1762166754.471395:0:7432:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166754.471453:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc7000/0x2f180c4effb0a78e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.471468:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc7000/0x2f180c4effb0a78e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.471503:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc7000/0x2f180c4effb0a78e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.471521:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6400/0x2f180c4effb0a795 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xef8a66a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.471528:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6400/0x2f180c4effb0a795 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xef8a66a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.471536:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6400/0x2f180c4effb0a795 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xef8a66a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.472049:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc7c00/0x2f180c4effb0a79c lrc: 3/0,1 mode: --/PW res: [0x200000403:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.472058:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc7c00/0x2f180c4effb0a79c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.472066:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc7c00/0x2f180c4effb0a79c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00010000:3.0:1762166754.472081:0:7432:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000eb46c7f6 reply state 00000000d259dd45 transno 4294968786 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc7c00/0x2f180c4effb0a79c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.472092:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc7c00/0x2f180c4effb0a79c lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.472099:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe:0x0].0x0 (ffff945cd1ddd400) 00010000:00010000:3.0:1762166754.472108:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1762166754.472112:0:7432:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1762166754.472116:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0xe:0x0]: returning size 4096 00010000:00010000:3.0:1762166754.472124:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc7000/0x2f180c4effb0a78e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.472131:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc7000/0x2f180c4effb0a78e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.472137:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc7000/0x2f180c4effb0a78e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.472143:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc7000/0x2f180c4effb0a78e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.472150:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3dc7000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166754.472154:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc7000/0x2f180c4effb0a78e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.472162:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc7000/0x2f180c4effb0a78e lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.472172:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:3.0:1762166754.472175:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166754.472178:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc7000/0x2f180c4effb0a78e lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.472184:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc7000/0x2f180c4effb0a78e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00000004:00010000:3.0:1762166754.472195:0:7432:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000eb46c7f6 reply state 00000000d259dd45 transno 4294968786 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6400/0x2f180c4effb0a795 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xef8a66a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.472203:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6400/0x2f180c4effb0a795 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef8a66a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.472220:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef8a66a9 (ffff945cd1dddd00) 00010000:00010000:3.0:1762166754.472223:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1762166754.472226:0:7432:0:(service.c:177:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1762166754.472297:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+9:37055:x1847765439969792:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 1032us (1136us total) trans 4294968786 rc 0/0 00000100:00100000:3.0:1762166754.472305:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2435 00000100:00100000:3.0:1762166754.480288:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166754.480341:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439969920 00000100:00100000:0.0:1762166754.480352:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439969920 00000100:00100000:0.0:1762166754.480415:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2436 00000100:00100000:0.0:1762166754.480430:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+9:37058:x1847765439969920:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166754.480453:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166754.480473:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0a7a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7486 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166754.480563:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3000/0x2f180c4effb0a7aa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166754.480584:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3000/0x2f180c4effb0a7aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166754.480595:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3000/0x2f180c4effb0a7aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:0.0:1762166754.480640:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1762166754.480645:0:7432:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166754.480664:0:7432:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3000/0x2f180c4effb0a7aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166754.480691:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0a7a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7486 expref: 11 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166754.480722:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3000/0x2f180c4effb0a7aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7486 expref: 10 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166754.480731:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:0.0:1762166754.480734:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1762166754.480738:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcc9e3000, rc 0) 00000100:00100000:0.0:1762166754.480798:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+10:37058:x1847765439969920:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 372us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166754.480807:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2436 00000100:00100000:1.0:1762166754.482123:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166754.482154:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439970048 00000100:00100000:0.0:1762166754.482160:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439970048 00000100:00100000:0.0:1762166754.482196:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2437 00000100:00100000:0.0:1762166754.482206:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+10:37058:x1847765439970048:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166754.482219:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166754.482231:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2800/0x2f180c4effb0a7b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b748d expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166754.482280:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3800/0x2f180c4effb0a7b8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166754.482288:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3800/0x2f180c4effb0a7b8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166754.482296:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3800/0x2f180c4effb0a7b8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166754.482306:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3600/0x2f180c4effb0a7bf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x67e404aa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166754.482310:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3600/0x2f180c4effb0a7bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67e404aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166754.482315:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3600/0x2f180c4effb0a7bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67e404aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166754.482344:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3800/0x2f180c4effb0a7b8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166754.482348:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3800/0x2f180c4effb0a7b8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166754.482351:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3800/0x2f180c4effb0a7b8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166754.482355:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3800/0x2f180c4effb0a7b8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166754.482359:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcc9e3800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166754.482361:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3800/0x2f180c4effb0a7b8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166754.482373:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3800/0x2f180c4effb0a7b8 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166754.482381:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:0.0:1762166754.482382:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166754.482386:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3800/0x2f180c4effb0a7b8 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166754.482392:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3800/0x2f180c4effb0a7b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166754.482405:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3600/0x2f180c4effb0a7bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67e404aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166754.482424:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3600/0x2f180c4effb0a7bf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67e404aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166754.482431:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3600/0x2f180c4effb0a7bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67e404aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166754.482436:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcc9e3600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166754.482439:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3600/0x2f180c4effb0a7bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67e404aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166754.482444:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3600/0x2f180c4effb0a7bf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67e404aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166754.482452:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x67e404aa (ffff945bc403a200) 00010000:00010000:0.0:1762166754.482455:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166754.482457:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3600/0x2f180c4effb0a7bf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x67e404aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166754.482463:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3600/0x2f180c4effb0a7bf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x67e404aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166754.482530:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2800/0x2f180c4effb0a7b1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b748d expref: 11 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166754.482538:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:0.0:1762166754.482540:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166754.482543:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2800/0x2f180c4effb0a7b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b748d expref: 11 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166754.482549:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcc9e2800, rc 0) 00000100:00100000:0.0:1762166754.482588:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+10:37058:x1847765439970048:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 383us (464us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166754.482595:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2437 00000100:00100000:3.0:1762166754.485558:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166754.485601:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439970304 00000100:00100000:0.0:1762166754.485610:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439970304 00000100:00100000:0.0:1762166754.485663:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2438 00000100:00100000:0.0:1762166754.485673:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+11:37058:x1847765439970304:12345-192.168.204.38@tcp:36:lfs.0 00000100:00100000:0.0:1762166754.485774:0:7432:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:7432:1847765446770688:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1762166754.485822:0:7432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166754.485875:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446770688 00000100:00100000:0.0:1762166754.485878:0:7432:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc2d8c480 going to sleep for 11 seconds 00000100:00100000:2.0:1762166754.485881:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446770688 00000100:00100000:2.0:1762166754.485924:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 536 00000100:00100000:2.0:1762166754.485938:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:7432:x1847765446770688:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1762166754.486009:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:7432:x1847765446770688:12345-0@lo:1000:mdt00_003.0 Request processed in 77us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166754.486017:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 536 00000100:00100000:0.0:1762166754.486059:0:7432:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:7432:1847765446770688:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1762166754.486107:0:7432:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:7432:1847765446770816:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1762166754.486130:0:7432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166754.486154:0:7432:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc2d8c780 going to sleep for 11 seconds 00000100:00100000:2.0:1762166754.486192:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446770816 00000100:00100000:2.0:1762166754.486195:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446770816 00000100:00100000:2.0:1762166754.486217:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 537 00000100:00100000:2.0:1762166754.486222:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf7839180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:7432:x1847765446770816:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1762166754.486274:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf7839180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:7432:x1847765446770816:12345-0@lo:1000:mdt00_003.0 Request processed in 52us (144us total) trans 0 rc -2/-2 00000100:00100000:2.0:1762166754.486279:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 537 00000100:00100000:0.0:1762166754.486293:0:7432:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:7432:1847765446770816:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1762166754.486338:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bcc9e2e00/0x2f180c4effb0a7c6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166754.486360:0:7432:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bcc9e2e00/0x2f180c4effb0a7c6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 7432 initiator: MDT1 00010000:00010000:0.0:1762166754.486370:0:7432:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bcc9e2e00/0x2f180c4effb0a7c6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 7432 initiator: MDT1 00000100:00100000:0.0:1762166754.486382:0:7432:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:7432:1847765446770944:0@lo:101:mdt00_003.0 00000100:00100000:0.0:1762166754.486404:0:7432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166754.486425:0:7432:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc2d8c780 going to sleep for 11 seconds 00000100:00100000:2.0:1762166754.486447:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446770944 00000100:00100000:2.0:1762166754.486453:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446770944 00000100:00100000:0.0:1762166754.486509:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 538 00000100:00100000:0.0:1762166754.486516:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf7838a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:7432:x1847765446770944:12345-0@lo:101:mdt00_003.0 00010000:00010000:0.0:1762166754.486524:0:6500:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166754.486534:0:6500:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2200/0x2f180c4effb0a7cd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f180c4effb0a7c6 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166754.486561:0:6500:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3000/0x2f180c4effb0a7aa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7486 expref: 9 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166754.486570:0:6500:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2200/0x2f180c4effb0a7cd lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x2f180c4effb0a7c6 expref: 8 pid: 6500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166754.486594:0:6500:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3000/0x2f180c4effb0a7aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7486 expref: 9 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166754.486607:0:6500:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3000/0x2f180c4effb0a7aa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7486 expref: 9 pid: 7432 timeout: 473 lvb_type: 0 00000100:00100000:0.0:1762166754.486619:0:6500:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe37b80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:6500:1847765446771072:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166754.486668:0:6500:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc2d8c480 going to sleep for 11 seconds 00000100:00100000:0.0:1762166754.487957:0:6500:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe37b80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:6500:1847765446771072:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166754.487979:0:6500:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2200/0x2f180c4effb0a7cd lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb0a7c6 expref: 8 pid: 6500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166754.487990:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:0.0:1762166754.487993:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166754.487996:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2200/0x2f180c4effb0a7cd lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb0a7c6 expref: 8 pid: 6500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166754.488004:0:6500:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcc9e2200, rc 0) 00000100:00100000:0.0:1762166754.488062:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf7838a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:7432:x1847765446770944:12345-0@lo:101:mdt00_003.0 Request processed in 1545us (1656us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166754.488069:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 538 00000100:00100000:3.0:1762166754.488540:0:7432:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:7432:1847765446770944:0@lo:101:mdt00_003.0 00010000:00010000:3.0:1762166754.488561:0:7432:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bcc9e2e00/0x2f180c4effb0a7c6 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0a7cd expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166754.488572:0:7432:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bcc9e2e00/0x2f180c4effb0a7c6 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x2f180c4effb0a7cd expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166754.488795:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166754.488843:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439970432 00000100:00100000:3.0:1762166754.488848:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439970432 00010000:00010000:3.0:1762166754.488872:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3000/0x2f180c4effb0a7aa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7486 expref: 10 pid: 7432 timeout: 473 lvb_type: 0 00000100:00100000:3.0:1762166754.488903:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 564 00000100:00100000:3.0:1762166754.488911:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+10:2418:x1847765439970432:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166754.488934:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166754.488941:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3000/0x2f180c4effb0a7aa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7486 expref: 10 pid: 7432 timeout: 473 lvb_type: 0 00010000:00010000:3.0:1762166754.488952:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3000/0x2f180c4effb0a7aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7486 expref: 10 pid: 7432 timeout: 473 lvb_type: 0 00010000:00010000:3.0:1762166754.488982:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3000/0x2f180c4effb0a7aa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7486 expref: 10 pid: 7432 timeout: 473 lvb_type: 0 00010000:00010000:3.0:1762166754.488994:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:3.0:1762166754.488998:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2200/0x2f180c4effb0a7cd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb0a7c6 expref: 7 pid: 6500 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166754.489006:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2200/0x2f180c4effb0a7cd lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x2f180c4effb0a7c6 expref: 7 pid: 6500 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166754.489014:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2200/0x2f180c4effb0a7cd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x2f180c4effb0a7c6 expref: 7 pid: 6500 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166754.489048:0:8398:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2200/0x2f180c4effb0a7cd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb0a7c6 expref: 7 pid: 6500 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166754.489060:0:8398:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55dea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:8398:1847765446771200:0@lo:105: 00000100:00100000:3.0:1762166754.489089:0:8398:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166754.489121:0:8398:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1c86000 going to sleep for 11 seconds 00000100:00100000:0.0:1762166754.489161:0:6478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446771200 00000100:00100000:0.0:1762166754.489166:0:6478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446771200 00000100:00100000:0.0:1762166754.489195:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1762166754.489200:0:6478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:8398:x1847765446771200:12345-0@lo:105: 00010000:00010000:0.0:1762166754.489209:0:6478:0:(ldlm_lockd.c:2517:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bcc9e2e00/0x2f180c4effb0a7c6 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x2f180c4effb0a7cd expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166754.489217:0:6478:0:(ldlm_lockd.c:1967:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bcc9e2e00/0x2f180c4effb0a7c6 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x2f180c4effb0a7cd expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166754.489224:0:6478:0:(ldlm_lockd.c:2044:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bcc9e2e00/0x2f180c4effb0a7c6 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0a7cd expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166754.489231:0:6478:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bcc9e2e00/0x2f180c4effb0a7c6 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x2f180c4effb0a7cd expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166754.489243:0:6478:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bcc9e2e00/0x2f180c4effb0a7c6 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x2f180c4effb0a7cd expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166754.489252:0:6478:0:(ldlm_lockd.c:2072:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bcc9e2e00/0x2f180c4effb0a7c6 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x2f180c4effb0a7cd expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166754.489271:0:6478:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff945bcc9e2e00) 00010000:00010000:3.0:1762166754.489294:0:7432:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bcc9e2e00/0x2f180c4effb0a7c6 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x2f180c4effb0a7cd expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166754.489302:0:7432:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bcc9e2e00/0x2f180c4effb0a7c6 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x2f180c4effb0a7cd expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1762166754.489317:0:7432:0:(osp_object.c:1389:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:0.0:1762166754.489323:0:6478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:8398:x1847765446771200:12345-0@lo:105: Request processed in 116us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166754.489331:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1762166754.489340:0:8398:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55dea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:8398:1847765446771200:0@lo:105: 00010000:00010000:3.0:1762166754.489350:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cf3dc7800/0x2f180c4effb0a7d4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x67e404aa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.489354:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166754.489369:0:7432:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cf3dc7800/0x2f180c4effb0a7d4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x67e404aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7432 initiator: MDT1 00010000:00010000:3.0:1762166754.489376:0:7432:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cf3dc7800/0x2f180c4effb0a7d4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x67e404aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7432 initiator: MDT1 00000100:00100000:3.0:1762166754.489388:0:7432:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55ddc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:7432:1847765446771328:0@lo:101:mdt00_003.0 00000100:00100000:2.0:1762166754.489401:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+9:2418:x1847765439970432:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 490us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166754.489410:0:7432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166754.489421:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 564 00000100:00100000:3.0:1762166754.489435:0:7432:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1c86240 going to sleep for 11 seconds 00000100:00100000:0.0:1762166754.489560:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446771328 00000100:00100000:0.0:1762166754.489565:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446771328 00000100:00100000:0.0:1762166754.489594:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 539 00000100:00100000:0.0:1762166754.489600:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:7432:x1847765446771328:12345-0@lo:101:mdt00_003.0 00010000:00010000:0.0:1762166754.489613:0:6500:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166754.489626:0:6500:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0a7db lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x67e404aa bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f180c4effb0a7d4 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166754.489643:0:6500:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0a7db lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x67e404aa bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x2f180c4effb0a7d4 expref: 9 pid: 6500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166754.489653:0:6500:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0a7db lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x67e404aa bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb0a7d4 expref: 9 pid: 6500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166754.489659:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x67e404aa (ffff945bc403a800) 00010000:00010000:0.0:1762166754.489662:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166754.489664:0:6500:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcc9e2a00, rc 0) 00000100:00100000:0.0:1762166754.489702:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:7432:x1847765446771328:12345-0@lo:101:mdt00_003.0 Request processed in 101us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166754.489709:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 539 00000100:00100000:3.0:1762166754.489718:0:7432:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55ddc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:7432:1847765446771328:0@lo:101:mdt00_003.0 00010000:00010000:3.0:1762166754.489730:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cf3dc7800/0x2f180c4effb0a7d4 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x67e404aa bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0a7db expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166754.489739:0:7432:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cf3dc7800/0x2f180c4effb0a7d4 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x67e404aa bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x2f180c4effb0a7db expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1762166754.489749:0:7432:0:(osp_object.c:1389:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:3.0:1762166754.489779:0:7432:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55ddc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:7432:1847765446771456:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1762166754.489803:0:7432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166754.489824:0:7432:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1c86000 going to sleep for 11 seconds 00000100:00100000:0.0:1762166754.489840:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446771456 00000100:00100000:0.0:1762166754.489845:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446771456 00000100:00100000:0.0:1762166754.489868:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 540 00000100:00100000:0.0:1762166754.489873:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:7432:x1847765446771456:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1762166754.489921:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:7432:x1847765446771456:12345-0@lo:1000:mdt00_003.0 Request processed in 48us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166754.489928:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 540 00000100:00100000:3.0:1762166754.489951:0:7432:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55ddc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:7432:1847765446771456:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1762166754.489985:0:7432:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55ddc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:7432:1847765446771584:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1762166754.490008:0:7432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166754.490026:0:7432:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1c86000 going to sleep for 11 seconds 00000100:00100000:0.0:1762166754.490051:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446771584 00000100:00100000:0.0:1762166754.490056:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446771584 00000100:00100000:0.0:1762166754.490087:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 541 00000100:00100000:0.0:1762166754.490093:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:7432:x1847765446771584:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1762166754.490166:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:7432:x1847765446771584:12345-0@lo:1000:mdt00_003.0 Request processed in 73us (157us total) trans 0 rc -2/-2 00000100:00100000:0.0:1762166754.490172:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 541 00000100:00100000:3.0:1762166754.490208:0:7432:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55ddc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:7432:1847765446771584:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1762166754.490271:0:7432:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55ddc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:7432:1847765446771712:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1762166754.490301:0:7432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166754.490320:0:7432:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1c86000 going to sleep for 11 seconds 00000100:00100000:0.0:1762166754.490336:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446771712 00000100:00100000:0.0:1762166754.490341:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446771712 00000100:00100000:0.0:1762166754.490368:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 542 00000100:00100000:0.0:1762166754.490374:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:7432:x1847765446771712:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1762166754.490427:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:7432:x1847765446771712:12345-0@lo:1000:mdt00_003.0 Request processed in 52us (124us total) trans 0 rc -2/-2 00000100:00100000:0.0:1762166754.490434:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 542 00000100:00100000:3.0:1762166754.490442:0:7432:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55ddc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:7432:1847765446771712:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1762166754.490526:0:7432:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:7432:1847765446771840:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1762166754.490549:0:7432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166754.490568:0:7432:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1c86000 going to sleep for 11 seconds 00000100:00100000:0.0:1762166754.490569:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446771840 00000100:00100000:0.0:1762166754.490574:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446771840 00000100:00100000:0.0:1762166754.490595:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 543 00000100:00100000:0.0:1762166754.490599:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:7432:x1847765446771840:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1762166754.490644:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:7432:x1847765446771840:12345-0@lo:1000:mdt00_003.0 Request processed in 44us (94us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166754.490650:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 543 00000100:00100000:3.0:1762166754.490666:0:7432:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:7432:1847765446771840:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1762166754.490703:0:7432:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:7432:1847765446771968:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1762166754.490726:0:7432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166754.490744:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446771968 00000100:00100000:3.0:1762166754.490747:0:7432:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1c86000 going to sleep for 11 seconds 00000100:00100000:0.0:1762166754.490748:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446771968 00000100:00100000:0.0:1762166754.490769:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 544 00000100:00100000:0.0:1762166754.490772:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:7432:x1847765446771968:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1762166754.490804:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:7432:x1847765446771968:12345-0@lo:1000:mdt00_003.0 Request processed in 31us (77us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166754.490808:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 544 00000100:00100000:3.0:1762166754.490838:0:7432:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:7432:1847765446771968:0@lo:1000:mdt00_003.0 00000040:00080000:3.0:1762166754.491300:0:7432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x2:0x0].5, 1112 off38552 00000040:00080000:3.0:1762166754.491358:0:7432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x2:0x0].5, 1256 off39272 00000004:00080000:3.0:1762166754.491365:0:7432:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff945cf1c86240 with version 12 00000004:00080000:0.0:1762166754.491399:0:7425:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff945cc6268300 version 12 rpc_version 12 00000020:00100000:0.0:1762166754.491419:0:7425:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1762166754.491426:0:7425:0:(client.c:796:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff945bcbe37b80 x1847765446772224/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2544/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1762166754.491441:0:7425:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe37b80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7425:1847765446772224:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1762166754.491470:0:7425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166754.491547:0:7425:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc2d8c480 going to sleep for 11 seconds 00000100:00100000:2.0:1762166754.491669:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446772224 00000100:00100000:2.0:1762166754.491673:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446772224 00000100:00100000:2.0:1762166754.491697:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 545 00000100:00100000:2.0:1762166754.491703:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:7425:x1847765446772224:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1762166754.491988:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:7425:x1847765446772224:12345-0@lo:1000:osp_up0-1.0 Request processed in 284us (515us total) trans 4294968787 rc 0/0 00000100:00100000:2.0:1762166754.491996:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 545 00000100:00100000:0.0:1762166754.492067:0:7425:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe37b80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7425:1847765446772224:0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1762166754.492136:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3dc7000/0x2f180c4effb0a7e2 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.492149:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3dc7000/0x2f180c4effb0a7e2 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT1 00010000:00010000:3.0:1762166754.492159:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3dc7000/0x2f180c4effb0a7e2 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT1 00000004:00010000:3.0:1762166754.492173:0:7432:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000886bfbb4 reply state 0000000024e8a2de transno 4294967369 ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3dc7000/0x2f180c4effb0a7e2 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT1 00010000:00010000:3.0:1762166754.492183:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3dc7000/0x2f180c4effb0a7e2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT1 00010000:00010000:3.0:1762166754.492199:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x4:0x0].0x0 (ffff945cd1ddda00) 00010000:00010000:3.0:1762166754.492201:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1762166754.492205:0:7432:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1762166754.492210:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000403:0x4:0x0]: returning size 4096 00000004:00080000:3.0:1762166754.492217:0:7432:0:(osp_object.c:1389:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1762166754.492224:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bcc9e2e00/0x2f180c4effb0a7c6 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x2f180c4effb0a7cd expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166754.492232:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bcc9e2e00/0x2f180c4effb0a7c6 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x2f180c4effb0a7cd expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166754.492239:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bcc9e2e00/0x2f180c4effb0a7c6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x2f180c4effb0a7cd expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166754.492261:0:7432:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1762166754.492265:0:7432:0:(osp_object.c:1389:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1762166754.492269:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cf3dc7800/0x2f180c4effb0a7d4 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x67e404aa bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0a7db expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166754.492275:0:7432:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cf3dc7800/0x2f180c4effb0a7d4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x67e404aa bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0a7db expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166754.492289:0:10257:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166754.492298:0:10257:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bcc9e2e00/0x2f180c4effb0a7c6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x2f180c4effb0a7cd expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166754.492308:0:10257:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcc9e2e00 already unused, calling callback (ffffffffc18ef820) 00010000:00010000:1.0:1762166754.492313:0:10257:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bcc9e2e00/0x2f180c4effb0a7c6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x2f180c4effb0a7cd expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1762166754.492322:0:10257:0:(mdt_handler.c:3944:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bcc9e2e00/0x2f180c4effb0a7c6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x2f180c4effb0a7cd expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166754.492343:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+13:37058:x1847765439970304:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 6670us (6791us total) trans 4294967369 rc 0/0 00010000:00010000:1.0:1762166754.492347:0:10257:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bcc9e2e00/0x2f180c4effb0a7c6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x2f180c4effb0a7cd expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166754.492354:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2438 00010000:00010000:1.0:1762166754.492370:0:10257:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1762166754.492399:0:10257:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bcc9e2e00/0x2f180c4effb0a7c6 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x2f180c4effb0a7cd expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166754.492407:0:10257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bcc9e2e00/0x2f180c4effb0a7c6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x2f180c4effb0a7cd expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166754.492419:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446772352:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1762166754.492421:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166754.492425:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166754.492429:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166754.492456:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166754.492516:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446772352 00000100:00100000:2.0:1762166754.492522:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446772352 00000100:00100000:2.0:1762166754.492560:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1762166754.492568:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe36300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+10:3635:x1847765446772352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1762166754.492577:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166754.492593:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2200/0x2f180c4effb0a7cd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x2f180c4effb0a7c6 expref: 10 pid: 6500 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166754.492606:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:2.0:1762166754.492610:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166754.492650:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe36300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+9:3635:x1847765446772352:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166754.492657:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1762166754.492721:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446772352:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1762166754.501194:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166754.501253:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439970560 00000100:00100000:3.0:1762166754.501264:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439970560 00000100:00100000:3.0:1762166754.501321:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2439 00000100:00100000:3.0:1762166754.501333:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+9:37063:x1847765439970560:12345-192.168.204.38@tcp:101:rm.0 00010000:00010000:3.0:1762166754.501368:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166754.501388:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6000/0x2f180c4effb0a7e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7494 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166754.501463:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc7e00/0x2f180c4effb0a7f0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.501508:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc7e00/0x2f180c4effb0a7f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.501522:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc7e00/0x2f180c4effb0a7f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:3.0:1762166754.501566:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1762166754.501571:0:7432:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166754.501602:0:7432:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc7e00/0x2f180c4effb0a7f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.501626:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6000/0x2f180c4effb0a7e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7494 expref: 11 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166754.501641:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc7e00/0x2f180c4effb0a7f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7494 expref: 10 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166754.501650:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:3.0:1762166754.501653:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1762166754.501657:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3dc7e00, rc 0) 00000100:00100000:3.0:1762166754.501716:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+10:37063:x1847765439970560:12345-192.168.204.38@tcp:101:rm.0 Request processed in 385us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166754.501724:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2439 00000100:00100000:2.0:1762166754.503311:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166754.503348:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439970688 00000100:00100000:3.0:1762166754.503359:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439970688 00000100:00100000:3.0:1762166754.503387:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2440 00000100:00100000:3.0:1762166754.503393:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+10:37063:x1847765439970688:12345-192.168.204.38@tcp:101:rm.0 00010000:00010000:3.0:1762166754.503404:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166754.503412:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc7400/0x2f180c4effb0a7f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b749b expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166754.503447:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6200/0x2f180c4effb0a7fe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.503457:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6200/0x2f180c4effb0a7fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.503465:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6200/0x2f180c4effb0a7fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.503498:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6c00/0x2f180c4effb0a805 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef8a66a9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.503508:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6c00/0x2f180c4effb0a805 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef8a66a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.503515:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6c00/0x2f180c4effb0a805 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef8a66a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.503578:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6600/0x2f180c4effb0a80c lrc: 3/1,0 mode: --/PR res: [0x200000403:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.503584:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6600/0x2f180c4effb0a80c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.503588:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6600/0x2f180c4effb0a80c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:3.0:1762166754.503615:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0xe:0x0]: returning size 4096 00000004:00200000:3.0:1762166754.503618:0:7432:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166754.503628:0:7432:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6600/0x2f180c4effb0a80c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.503636:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6200/0x2f180c4effb0a7fe lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.503640:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6200/0x2f180c4effb0a7fe lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.503643:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6200/0x2f180c4effb0a7fe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.503647:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6200/0x2f180c4effb0a7fe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.503650:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3dc6200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166754.503653:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6200/0x2f180c4effb0a7fe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.503658:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6200/0x2f180c4effb0a7fe lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.503664:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:3.0:1762166754.503666:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166754.503668:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6200/0x2f180c4effb0a7fe lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.503671:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6200/0x2f180c4effb0a7fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.503678:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6c00/0x2f180c4effb0a805 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef8a66a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.503685:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6c00/0x2f180c4effb0a805 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef8a66a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.503689:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6c00/0x2f180c4effb0a805 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef8a66a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.503691:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3dc6c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166754.503693:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6c00/0x2f180c4effb0a805 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef8a66a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.503696:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6c00/0x2f180c4effb0a805 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef8a66a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.503700:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef8a66a9 (ffff945cd1dddd00) 00010000:00010000:3.0:1762166754.503701:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166754.503703:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6c00/0x2f180c4effb0a805 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef8a66a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.503706:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6c00/0x2f180c4effb0a805 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef8a66a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.503718:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc7400/0x2f180c4effb0a7f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b749b expref: 12 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166754.503726:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6600/0x2f180c4effb0a80c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xe:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b749b expref: 11 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166754.503730:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe:0x0].0x0 (ffff945cd1ddd400) 00010000:00010000:3.0:1762166754.503731:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1762166754.503733:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3dc6600, rc 0) 00000100:00100000:3.0:1762166754.503767:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+11:37063:x1847765439970688:12345-192.168.204.38@tcp:101:rm.0 Request processed in 375us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166754.503776:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2440 00000100:00100000:1.0:1762166754.505127:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166754.505169:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439970816 00000100:00100000:3.0:1762166754.505175:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439970816 00000100:00100000:3.0:1762166754.505208:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2441 00000100:00100000:3.0:1762166754.505213:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+11:37063:x1847765439970816:12345-192.168.204.38@tcp:101:rm.0 00010000:00010000:3.0:1762166754.505224:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166754.505233:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc7200/0x2f180c4effb0a813 lrc: 2/0,0 mode: --/CR res: [0x200000403:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b74a2 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166754.505262:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc7600/0x2f180c4effb0a81a lrc: 3/1,0 mode: --/CR res: [0x200000403:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.505270:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc7600/0x2f180c4effb0a81a lrc: 3/1,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.505283:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc7600/0x2f180c4effb0a81a lrc: 3/1,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.505295:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc7a00/0x2f180c4effb0a821 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.505303:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc7a00/0x2f180c4effb0a821 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.505309:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc7a00/0x2f180c4effb0a821 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.505334:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc7600/0x2f180c4effb0a81a lrc: 4/1,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.505341:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc7600/0x2f180c4effb0a81a lrc: 4/1,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.505359:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc7600/0x2f180c4effb0a81a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.505365:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc7600/0x2f180c4effb0a81a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.505370:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3dc7600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166754.505374:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc7600/0x2f180c4effb0a81a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.505379:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc7600/0x2f180c4effb0a81a lrc: 5/0,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.505386:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe:0x0].0x0 (ffff945cd1ddd400) 00010000:00010000:3.0:1762166754.505387:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166754.505390:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc7600/0x2f180c4effb0a81a lrc: 3/0,0 mode: --/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.505393:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc7600/0x2f180c4effb0a81a lrc: 0/0,0 mode: --/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.505400:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc7a00/0x2f180c4effb0a821 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.505403:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc7a00/0x2f180c4effb0a821 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.505406:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc7a00/0x2f180c4effb0a821 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.505409:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3dc7a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166754.505411:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc7a00/0x2f180c4effb0a821 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.505421:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc7a00/0x2f180c4effb0a821 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.505425:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe:0x0].0xff6e0927 (ffff945cd1ddd500) 00010000:00010000:3.0:1762166754.505426:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166754.505428:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc7a00/0x2f180c4effb0a821 lrc: 2/0,0 mode: --/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.505432:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc7a00/0x2f180c4effb0a821 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.505458:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc7200/0x2f180c4effb0a813 lrc: 1/0,0 mode: --/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b74a2 expref: 12 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166754.505467:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe:0x0].0x0 (ffff945cd1ddd400) 00010000:00010000:3.0:1762166754.505470:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166754.505473:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc7200/0x2f180c4effb0a813 lrc: 0/0,0 mode: --/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b74a2 expref: 12 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166754.505515:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3dc7200, rc 0) 00000100:00100000:3.0:1762166754.505555:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+11:37063:x1847765439970816:12345-192.168.204.38@tcp:101:rm.0 Request processed in 340us (440us total) trans 0 rc 301/301 00000100:00100000:3.0:1762166754.505563:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2441 00000100:00100000:2.0:1762166754.506552:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166754.506580:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439970944 00000100:00100000:3.0:1762166754.506586:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439970944 00000100:00100000:3.0:1762166754.506616:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2442 00000100:00100000:3.0:1762166754.506624:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+11:37063:x1847765439970944:12345-192.168.204.38@tcp:101:rm.0 00010000:00010000:3.0:1762166754.506635:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166754.506647:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6000/0x2f180c4effb0a828 lrc: 2/0,0 mode: --/CR res: [0x200000403:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b74a9 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166754.506673:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6a00/0x2f180c4effb0a82f lrc: 3/1,0 mode: --/CR res: [0x200000403:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.506678:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6a00/0x2f180c4effb0a82f lrc: 3/1,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.506684:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6a00/0x2f180c4effb0a82f lrc: 3/1,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.506690:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6e00/0x2f180c4effb0a836 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.506694:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6e00/0x2f180c4effb0a836 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.506698:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6e00/0x2f180c4effb0a836 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.506709:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6a00/0x2f180c4effb0a82f lrc: 4/1,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.506713:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6a00/0x2f180c4effb0a82f lrc: 4/1,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.506716:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6a00/0x2f180c4effb0a82f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.506720:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6a00/0x2f180c4effb0a82f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.506723:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3dc6a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166754.506725:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6a00/0x2f180c4effb0a82f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.506736:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6a00/0x2f180c4effb0a82f lrc: 5/0,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.506743:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe:0x0].0x0 (ffff945cd1ddd400) 00010000:00010000:3.0:1762166754.506746:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166754.506748:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6a00/0x2f180c4effb0a82f lrc: 3/0,0 mode: --/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.506754:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6a00/0x2f180c4effb0a82f lrc: 0/0,0 mode: --/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.506763:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6e00/0x2f180c4effb0a836 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.506769:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6e00/0x2f180c4effb0a836 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.506774:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6e00/0x2f180c4effb0a836 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.506779:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3dc6e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166754.506781:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6e00/0x2f180c4effb0a836 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.506787:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6e00/0x2f180c4effb0a836 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.506793:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe:0x0].0xff6e0927 (ffff945cd1ddde00) 00010000:00010000:3.0:1762166754.506796:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166754.506798:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6e00/0x2f180c4effb0a836 lrc: 2/0,0 mode: --/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.506804:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6e00/0x2f180c4effb0a836 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.506831:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6000/0x2f180c4effb0a828 lrc: 1/0,0 mode: --/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b74a9 expref: 12 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166754.506839:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe:0x0].0x0 (ffff945cd1ddd400) 00010000:00010000:3.0:1762166754.506842:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166754.506845:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6000/0x2f180c4effb0a828 lrc: 0/0,0 mode: --/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b74a9 expref: 12 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166754.506854:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3dc6000, rc 0) 00000100:00100000:3.0:1762166754.506881:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+11:37063:x1847765439970944:12345-192.168.204.38@tcp:101:rm.0 Request processed in 258us (331us total) trans 0 rc 301/301 00000100:00100000:3.0:1762166754.506885:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2442 00000100:00100000:2.0:1762166754.508153:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166754.508185:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439971072 00000100:00100000:3.0:1762166754.508191:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439971072 00000100:00100000:3.0:1762166754.508219:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2443 00000100:00100000:3.0:1762166754.508225:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+11:37063:x1847765439971072:12345-192.168.204.38@tcp:101:rm.0 00010000:00010000:3.0:1762166754.508234:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166754.508243:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc7400/0x2f180c4effb0a83d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b74b0 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166754.508273:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6c00/0x2f180c4effb0a844 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.508281:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6c00/0x2f180c4effb0a844 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.508288:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6c00/0x2f180c4effb0a844 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.508308:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6200/0x2f180c4effb0a84b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x67e404aa bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.508316:0:7432:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0a7db lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x67e404aa bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb0a7d4 expref: 8 pid: 6500 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166754.508323:0:7432:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6200/0x2f180c4effb0a84b lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x67e404aa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166754.508349:0:7432:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0a7db lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x67e404aa bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x2f180c4effb0a7d4 expref: 8 pid: 6500 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166754.508362:0:7432:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765446772480:0@lo:104: 00000100:00100000:3.0:1762166754.508399:0:7432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166754.508445:0:7432:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cca8aee40 going to sleep for 11 seconds 00000100:00100000:0.0:1762166754.508458:0:6478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446772480 00000100:00100000:0.0:1762166754.508465:0:6478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446772480 00000100:00100000:0.0:1762166754.508520:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1762166754.508525:0:6478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4945880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:7432:x1847765446772480:12345-0@lo:104: 00010000:00010000:0.0:1762166754.508540:0:6478:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cf3dc7800/0x2f180c4effb0a7d4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x67e404aa bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x2f180c4effb0a7db expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166754.508580:0:6478:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1762166754.508584:0:6478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4945880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:7432:x1847765446772480:12345-0@lo:104: Request processed in 60us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166754.508589:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00010000:1.0:1762166754.508609:0:10256:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1762166754.508616:0:7432:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765446772480:0@lo:104: 00010000:00010000:1.0:1762166754.508618:0:10256:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cf3dc7800/0x2f180c4effb0a7d4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x67e404aa bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x2f180c4effb0a7db expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166754.508635:0:10256:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3dc7800 already unused, calling callback (ffffffffc18ef820) 00010000:00010000:1.0:1762166754.508641:0:10256:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cf3dc7800/0x2f180c4effb0a7d4 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x67e404aa bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x2f180c4effb0a7db expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166754.508642:0:7432:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6200/0x2f180c4effb0a84b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x67e404aa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00010000:1.0:1762166754.508660:0:10256:0:(mdt_handler.c:3944:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cf3dc7800/0x2f180c4effb0a7d4 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x67e404aa bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x2f180c4effb0a7db expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166754.508691:0:10256:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cf3dc7800/0x2f180c4effb0a7d4 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x67e404aa bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x2f180c4effb0a7db expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166754.508698:0:10256:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1762166754.508722:0:10256:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cf3dc7800/0x2f180c4effb0a7d4 lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x67e404aa bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x2f180c4effb0a7db expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166754.508729:0:10256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cf3dc7800/0x2f180c4effb0a7d4 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x67e404aa bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x2f180c4effb0a7db expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166754.508738:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446772608:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1762166754.508758:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166754.508761:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166754.508764:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166754.508773:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166754.508831:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446772608 00000100:00100000:2.0:1762166754.508842:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446772608 00010000:00010000:2.0:1762166754.508861:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0a7db lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x67e404aa bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x2f180c4effb0a7d4 expref: 9 pid: 6500 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166754.508890:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 565 00000100:00100000:2.0:1762166754.508899:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4944000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+9:3636:x1847765446772608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1762166754.508908:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:1.0:1762166754.509847:0:6475:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968787 is committed 00000001:00080000:1.0:1762166754.509861:0:6475:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968786 is committed 00000004:00080000:1.0:1762166754.509867:0:6475:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 91 committed 00010000:00010000:0.0:1762166754.509890:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6400/0x2f180c4effb0a795 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef8a66a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166754.509899:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6400/0x2f180c4effb0a795 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef8a66a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166754.509904:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6400/0x2f180c4effb0a795 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef8a66a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166754.509908:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3dc6400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166754.509911:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6400/0x2f180c4effb0a795 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef8a66a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166754.509922:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6400/0x2f180c4effb0a795 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef8a66a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166754.509935:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef8a66a9 (ffff945cd1dddd00) 00010000:00010000:0.0:1762166754.509937:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166754.509940:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6400/0x2f180c4effb0a795 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xef8a66a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166754.509944:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6400/0x2f180c4effb0a795 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xef8a66a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00000100:00100000:1.0:1762166754.509948:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4944a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446772736:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1762166754.509959:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0a7db lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x67e404aa bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x2f180c4effb0a7d4 expref: 7 pid: 6500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166754.509960:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc7c00/0x2f180c4effb0a79c lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00000100:00100000:3.0:1762166754.509975:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4946a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446772864:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1762166754.509976:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc7c00/0x2f180c4effb0a79c lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.509979:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x67e404aa (ffff945bc403a800) 00010000:00010000:2.0:1762166754.509989:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6200/0x2f180c4effb0a84b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x67e404aa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166754.509993:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc7c00/0x2f180c4effb0a79c lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00000100:00100000:1.0:1762166754.509994:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1762166754.510009:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3dc7c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166754.510010:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6200/0x2f180c4effb0a84b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67e404aa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166754.510015:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc7c00/0x2f180c4effb0a79c lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00000100:00100000:3.0:1762166754.510021:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1762166754.510031:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6200/0x2f180c4effb0a84b lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67e404aa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166754.510032:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc7c00/0x2f180c4effb0a79c lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166754.510059:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe:0x0].0x0 (ffff945cd1ddd400) 00010000:00010000:0.0:1762166754.510062:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166754.510065:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc7c00/0x2f180c4effb0a79c lrc: 2/0,0 mode: --/TXN res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166754.510069:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc7c00/0x2f180c4effb0a79c lrc: 0/0,0 mode: --/TXN res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00000100:00100000:3.0:1762166754.510078:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446772736 00010000:00010000:2.0:1762166754.510079:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166754.510084:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446772736 00010000:00010000:1.0:1762166754.510091:0:7432:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6200/0x2f180c4effb0a84b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67e404aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.510100:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6200/0x2f180c4effb0a84b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67e404aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000100:00100000:0.0:1762166754.510107:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446772864 00000100:00100000:0.0:1762166754.510111:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446772864 00000100:00100000:3.0:1762166754.510127:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 866 00000100:00100000:2.0:1762166754.510136:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4944000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+6:3636:x1847765446772608:12345-0@lo:103:ldlm_bl.0 Request processed in 1238us (1361us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166754.510141:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3633:x1847765446772736:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1762166754.510144:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 867 00000100:00100000:2.0:1762166754.510153:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 565 00000100:00100000:0.0:1762166754.510157:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4947b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3634:x1847765446772864:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1762166754.510169:0:8380:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:58 count 1 00002000:00080000:0.0:1762166754.510172:0:8382:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:59 count 1 00000100:00100000:1.0:1762166754.510178:0:7432:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7432:1847765446772992:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1762166754.510208:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446772608:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1762166754.510214:0:7432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166754.510233:0:7432:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc40336c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166754.510239:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446772992 00000100:00100000:2.0:1762166754.510245:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446772992 00002000:00010000:0.0:1762166754.510260:0:8382:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:3.0:1762166754.510263:0:8380:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1762166754.510266:0:8382:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e2800/0x2f180c4effb0a852 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166754.510271:0:8380:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945cc29ca800/0x2f180c4effb0a859 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166754.510276:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166754.510282:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166754.510285:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166754.510286:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1762166754.510290:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 546 00010000:00010000:0.0:1762166754.510290:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e2800/0x2f180c4effb0a852 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166754.510291:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cc29ca800/0x2f180c4effb0a859 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166754.510304:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7432:x1847765446772992:12345-0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1762166754.510314:0:8382:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e2800/0x2f180c4effb0a852 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166754.510319:0:8380:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cc29ca800/0x2f180c4effb0a859 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166754.510326:0:8382:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e2800/0x2f180c4effb0a852 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166754.510333:0:8380:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945cc29ca800/0x2f180c4effb0a859 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166754.510338:0:8382:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e2800/0x2f180c4effb0a852 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166754.510349:0:8380:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945cc29ca800/0x2f180c4effb0a859 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166754.510363:0:8382:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1762166754.510364:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7432:x1847765446772992:12345-0@lo:1000:mdt00_003.0 Request processed in 63us (151us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166754.510370:0:8380:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1762166754.510375:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 546 00000100:00100000:2.0:1762166754.510397:0:7432:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7432:1847765446772992:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1762166754.510436:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4800/0x2f180c4effb0a860 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.510458:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4800/0x2f180c4effb0a860 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.510467:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4800/0x2f180c4effb0a860 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00010000:2.0:1762166754.510526:0:7432:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4800/0x2f180c4effb0a860 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.510539:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6c00/0x2f180c4effb0a844 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.510547:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6c00/0x2f180c4effb0a844 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.510553:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6c00/0x2f180c4effb0a844 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.510559:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6c00/0x2f180c4effb0a844 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.510565:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3dc6c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166754.510570:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6c00/0x2f180c4effb0a844 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.510576:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6c00/0x2f180c4effb0a844 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.510587:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:2.0:1762166754.510590:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166754.510593:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6c00/0x2f180c4effb0a844 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.510600:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6c00/0x2f180c4effb0a844 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.510619:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6200/0x2f180c4effb0a84b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67e404aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.510625:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6200/0x2f180c4effb0a84b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67e404aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00000100:00100000:0.0:1762166754.510629:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4947b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3634:x1847765446772864:12345-0@lo:6:osp-syn-0-0.0 Request processed in 473us (611us total) trans 21474836634 rc 0/0 00010000:00010000:2.0:1762166754.510640:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6200/0x2f180c4effb0a84b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67e404aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00000100:00100000:0.0:1762166754.510644:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 867 00000100:00100000:3.0:1762166754.510646:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3633:x1847765446772736:12345-0@lo:6:osp-syn-0-0.0 Request processed in 506us (651us total) trans 21474836633 rc 0/0 00000004:00080000:1.0:1762166754.510646:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc4946a00/2, rc 0, transno 21474836634 00010000:00010000:2.0:1762166754.510660:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3dc6200 already unused, calling callback (ffffffffc18e2310) 00000100:00100000:1.0:1762166754.510660:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4946a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446772864:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1762166754.510663:0:7420:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:3.0:1762166754.510666:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 866 00010000:00010000:2.0:1762166754.510667:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6200/0x2f180c4effb0a84b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67e404aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166754.510671:0:7420:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e2800/0x2f180c4effb0a852 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166754.510687:0:7420:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcc9e2800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166754.510688:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6200/0x2f180c4effb0a84b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67e404aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166754.510691:0:7420:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e2800/0x2f180c4effb0a852 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166754.510693:0:6482:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762166754.510701:0:6482:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945cc29ca800/0x2f180c4effb0a859 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166754.510709:0:7420:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e2800/0x2f180c4effb0a852 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166754.510710:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x67e404aa (ffff945bc403a800) 00010000:00010000:3.0:1762166754.510716:0:6482:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29ca800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166754.510719:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166754.510726:0:6482:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc29ca800/0x2f180c4effb0a859 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166754.510726:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6200/0x2f180c4effb0a84b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x67e404aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166754.510731:0:7420:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e2800/0x2f180c4effb0a852 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166754.510743:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6200/0x2f180c4effb0a84b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x67e404aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166754.510753:0:7420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e2800/0x2f180c4effb0a852 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166754.510771:0:6482:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc29ca800/0x2f180c4effb0a859 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166754.510780:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166754.510785:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166754.510787:0:6482:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945cc29ca800/0x2f180c4effb0a859 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166754.510787:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166754.510790:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc7400/0x2f180c4effb0a83d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b74b0 expref: 11 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166754.510807:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cc29ca800/0x2f180c4effb0a859 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166754.510820:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4800/0x2f180c4effb0a860 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b74b0 expref: 10 pid: 7432 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1762166754.510822:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc4944a80/2, rc 0, transno 21474836633 00010000:00010000:3.0:1762166754.510824:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166754.510830:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166754.510833:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x4:0x0].0x0 (ffff945bc477f500) 00000100:00100000:0.0:1762166754.510833:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4944a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446772736:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1762166754.510834:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166754.510843:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1762166754.510846:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cb4800, rc 0) 00000100:00100000:2.0:1762166754.510890:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+10:37063:x1847765439971072:12345-192.168.204.38@tcp:101:rm.0 Request processed in 2663us (2737us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166754.510898:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2443 00000100:00100000:1.0:1762166754.512118:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166754.512158:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439971200 00000100:00100000:2.0:1762166754.512163:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439971200 00000100:00100000:2.0:1762166754.512191:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2444 00000100:00100000:2.0:1762166754.512197:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+13:37063:x1847765439971200:12345-192.168.204.38@tcp:101:rm.0 00010000:00010000:2.0:1762166754.512210:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166754.512229:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5c00/0x2f180c4effb0a867 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b74b7 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166754.512273:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0a86e lrc: 3/1,0 mode: --/PR res: [0x240000403:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.512282:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0a86e lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x4:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166754.512291:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0a86e lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x4:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT1 00000004:00200000:2.0:1762166754.512327:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000403:0x4:0x0]: returning size 4096 00000004:00200000:2.0:1762166754.512330:0:7432:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1762166754.512351:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5c00/0x2f180c4effb0a867 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b74b7 expref: 15 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166754.512361:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0a86e lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x4:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b74b7 expref: 14 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166754.512366:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x4:0x0].0x0 (ffff945cd1ddda00) 00010000:00010000:2.0:1762166754.512374:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:2.0:1762166754.512376:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cb5a00, rc 0) 00000100:00100000:2.0:1762166754.512406:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+14:37063:x1847765439971200:12345-192.168.204.38@tcp:101:rm.0 Request processed in 210us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166754.512411:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2444 00000100:00100000:3.0:1762166754.513571:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166754.513597:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439971328 00000100:00100000:2.0:1762166754.513603:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439971328 00000100:00100000:2.0:1762166754.513627:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2445 00000100:00100000:2.0:1762166754.513632:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4947800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+14:37063:x1847765439971328:12345-192.168.204.38@tcp:101:rm.0 00010000:00010000:2.0:1762166754.513641:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166754.513652:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4600/0x2f180c4effb0a875 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b74be expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166754.513692:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4000/0x2f180c4effb0a87c lrc: 3/1,0 mode: --/CR res: [0x240000403:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.513702:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4000/0x2f180c4effb0a87c lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166754.513710:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4000/0x2f180c4effb0a87c lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166754.513722:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0a883 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x4:0x0].0x83c42efe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.513729:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0a883 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x4:0x0].0x83c42efe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166754.513735:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0a883 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x4:0x0].0x83c42efe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166754.513764:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4000/0x2f180c4effb0a87c lrc: 4/1,0 mode: CR/CR res: [0x240000403:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166754.513775:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4000/0x2f180c4effb0a87c lrc: 4/1,0 mode: CR/CR res: [0x240000403:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166754.513778:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4000/0x2f180c4effb0a87c lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166754.513782:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4000/0x2f180c4effb0a87c lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166754.513786:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb4000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166754.513789:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4000/0x2f180c4effb0a87c lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166754.513793:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4000/0x2f180c4effb0a87c lrc: 5/0,0 mode: CR/CR res: [0x240000403:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166754.513799:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x4:0x0].0x0 (ffff945cd1ddda00) 00010000:00010000:2.0:1762166754.513800:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166754.513803:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4000/0x2f180c4effb0a87c lrc: 3/0,0 mode: --/CR res: [0x240000403:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166754.513807:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4000/0x2f180c4effb0a87c lrc: 0/0,0 mode: --/CR res: [0x240000403:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166754.513813:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0a883 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x4:0x0].0x83c42efe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166754.513816:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0a883 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x4:0x0].0x83c42efe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166754.513819:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0a883 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x4:0x0].0x83c42efe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166754.513822:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb4200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166754.513826:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0a883 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x4:0x0].0x83c42efe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166754.513830:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0a883 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x4:0x0].0x83c42efe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166754.513834:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x4:0x0].0x83c42efe (ffff945bc477fb00) 00010000:00010000:2.0:1762166754.513835:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166754.513837:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0a883 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x4:0x0].0x83c42efe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166754.513840:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0a883 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x4:0x0].0x83c42efe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166754.513857:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4600/0x2f180c4effb0a875 lrc: 1/0,0 mode: --/CR res: [0x240000403:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b74be expref: 15 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166754.513862:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x4:0x0].0x0 (ffff945cd1ddda00) 00010000:00010000:2.0:1762166754.513864:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166754.513866:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4600/0x2f180c4effb0a875 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b74be expref: 15 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166754.513870:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cb4600, rc 0) 00000100:00100000:2.0:1762166754.513897:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4947800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+14:37063:x1847765439971328:12345-192.168.204.38@tcp:101:rm.0 Request processed in 266us (330us total) trans 0 rc 301/301 00000100:00100000:2.0:1762166754.513902:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2445 00000100:00100000:3.0:1762166754.514885:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166754.514918:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439971456 00000100:00100000:2.0:1762166754.514924:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439971456 00000100:00100000:2.0:1762166754.514967:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2446 00000100:00100000:2.0:1762166754.514979:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4945c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+14:37063:x1847765439971456:12345-192.168.204.38@tcp:101:rm.0 00010000:00010000:2.0:1762166754.514994:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166754.515001:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0a88a lrc: 2/0,0 mode: --/CR res: [0x240000403:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b74c5 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166754.515025:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5400/0x2f180c4effb0a891 lrc: 3/1,0 mode: --/CR res: [0x240000403:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.515031:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5400/0x2f180c4effb0a891 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166754.515049:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5400/0x2f180c4effb0a891 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166754.515063:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5800/0x2f180c4effb0a898 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x4:0x0].0x83c42efe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.515073:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5800/0x2f180c4effb0a898 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x4:0x0].0x83c42efe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166754.515079:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5800/0x2f180c4effb0a898 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x4:0x0].0x83c42efe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166754.515097:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5400/0x2f180c4effb0a891 lrc: 4/1,0 mode: CR/CR res: [0x240000403:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166754.515104:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5400/0x2f180c4effb0a891 lrc: 4/1,0 mode: CR/CR res: [0x240000403:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166754.515110:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5400/0x2f180c4effb0a891 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166754.515115:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5400/0x2f180c4effb0a891 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166754.515119:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb5400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166754.515125:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5400/0x2f180c4effb0a891 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166754.515129:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5400/0x2f180c4effb0a891 lrc: 5/0,0 mode: CR/CR res: [0x240000403:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166754.515135:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x4:0x0].0x0 (ffff945cd1ddda00) 00010000:00010000:2.0:1762166754.515137:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166754.515139:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5400/0x2f180c4effb0a891 lrc: 3/0,0 mode: --/CR res: [0x240000403:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166754.515143:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5400/0x2f180c4effb0a891 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166754.515150:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5800/0x2f180c4effb0a898 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x4:0x0].0x83c42efe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166754.515153:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5800/0x2f180c4effb0a898 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x4:0x0].0x83c42efe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166754.515156:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5800/0x2f180c4effb0a898 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x4:0x0].0x83c42efe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166754.515159:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb5800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166754.515160:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5800/0x2f180c4effb0a898 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x4:0x0].0x83c42efe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166754.515163:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5800/0x2f180c4effb0a898 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x4:0x0].0x83c42efe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166754.515166:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x4:0x0].0x83c42efe (ffff945bc477f600) 00010000:00010000:2.0:1762166754.515167:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166754.515169:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5800/0x2f180c4effb0a898 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x4:0x0].0x83c42efe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166754.515177:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5800/0x2f180c4effb0a898 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x4:0x0].0x83c42efe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166754.515194:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0a88a lrc: 1/0,0 mode: --/CR res: [0x240000403:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b74c5 expref: 15 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166754.515199:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x4:0x0].0x0 (ffff945cd1ddda00) 00010000:00010000:2.0:1762166754.515201:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166754.515203:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0a88a lrc: 0/0,0 mode: --/CR res: [0x240000403:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b74c5 expref: 15 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166754.515208:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cb5000, rc 0) 00000100:00100000:2.0:1762166754.515235:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4945c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+14:37063:x1847765439971456:12345-192.168.204.38@tcp:101:rm.0 Request processed in 259us (351us total) trans 0 rc 301/301 00000100:00100000:2.0:1762166754.515239:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2446 00000100:00100000:1.0:1762166754.516216:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166754.516260:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439971584 00000100:00100000:2.0:1762166754.516264:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439971584 00000100:00100000:2.0:1762166754.516292:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2447 00000100:00100000:2.0:1762166754.516301:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+10:37063:x1847765439971584:12345-192.168.204.38@tcp:101:rm.0 00010000:00010000:2.0:1762166754.516312:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166754.516322:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5c00/0x2f180c4effb0a89f lrc: 2/0,0 mode: --/CR res: [0x200000403:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b74cc expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166754.516353:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1600/0x2f180c4effb0a8a6 lrc: 3/1,0 mode: --/CR res: [0x200000403:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.516359:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1600/0x2f180c4effb0a8a6 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.516372:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1600/0x2f180c4effb0a8a6 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.516425:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0a8ad lrc: 3/1,0 mode: --/PR res: [0x200000403:0xe:0x0].0x5cd003d6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.516430:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0a8ad lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe:0x0].0x5cd003d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.516434:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0a8ad lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe:0x0].0x5cd003d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.516453:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1600/0x2f180c4effb0a8a6 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.516457:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1600/0x2f180c4effb0a8a6 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.516460:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1600/0x2f180c4effb0a8a6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.516463:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1600/0x2f180c4effb0a8a6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.516466:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166754.516468:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1600/0x2f180c4effb0a8a6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.516471:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1600/0x2f180c4effb0a8a6 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.516494:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe:0x0].0x0 (ffff945cd1ddd400) 00010000:00010000:2.0:1762166754.516496:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166754.516504:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1600/0x2f180c4effb0a8a6 lrc: 3/0,0 mode: --/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.516508:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1600/0x2f180c4effb0a8a6 lrc: 0/0,0 mode: --/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.516515:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0a8ad lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe:0x0].0x5cd003d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.516519:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0a8ad lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xe:0x0].0x5cd003d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.516522:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0a8ad lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xe:0x0].0x5cd003d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.516525:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166754.516526:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0a8ad lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xe:0x0].0x5cd003d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.516529:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0a8ad lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xe:0x0].0x5cd003d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.516533:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe:0x0].0x5cd003d6 (ffff945bc477f800) 00010000:00010000:2.0:1762166754.516535:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166754.516536:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0a8ad lrc: 2/0,0 mode: --/PR res: [0x200000403:0xe:0x0].0x5cd003d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.516539:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0a8ad lrc: 0/0,0 mode: --/PR res: [0x200000403:0xe:0x0].0x5cd003d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.516555:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5c00/0x2f180c4effb0a89f lrc: 1/0,0 mode: --/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b74cc expref: 11 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166754.516560:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe:0x0].0x0 (ffff945cd1ddd400) 00010000:00010000:2.0:1762166754.516564:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166754.516567:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5c00/0x2f180c4effb0a89f lrc: 0/0,0 mode: --/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b74cc expref: 11 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166754.516575:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cb5c00, rc 0) 00000100:00100000:2.0:1762166754.516612:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+10:37063:x1847765439971584:12345-192.168.204.38@tcp:101:rm.0 Request processed in 309us (394us total) trans 0 rc 301/301 00000100:00100000:2.0:1762166754.516619:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2447 00000100:00100000:3.0:1762166754.517528:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166754.517556:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439971712 00000100:00100000:2.0:1762166754.517561:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439971712 00000100:00100000:2.0:1762166754.517585:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2448 00000100:00100000:2.0:1762166754.517589:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4946300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+10:37063:x1847765439971712:12345-192.168.204.38@tcp:101:rm.0 00010000:00010000:2.0:1762166754.517597:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166754.517605:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1c00/0x2f180c4effb0a8b4 lrc: 2/0,0 mode: --/CR res: [0x200000403:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b74d3 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166754.517628:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0a8bb lrc: 3/1,0 mode: --/CR res: [0x200000403:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.517634:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0a8bb lrc: 3/1,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.517639:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0a8bb lrc: 3/1,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.517646:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0a8c2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xe:0x0].0x5cd003d6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.517650:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0a8c2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe:0x0].0x5cd003d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.517653:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0a8c2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe:0x0].0x5cd003d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.517672:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0a8bb lrc: 4/1,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.517680:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0a8bb lrc: 4/1,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.517684:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0a8bb lrc: 3/0,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.517690:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0a8bb lrc: 4/0,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.517695:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166754.517698:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0a8bb lrc: 4/0,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.517704:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0a8bb lrc: 5/0,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.517713:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe:0x0].0x0 (ffff945cd1ddd400) 00010000:00010000:2.0:1762166754.517716:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166754.517719:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0a8bb lrc: 3/0,0 mode: --/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.517725:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0a8bb lrc: 0/0,0 mode: --/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.517733:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0a8c2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe:0x0].0x5cd003d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.517736:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0a8c2 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xe:0x0].0x5cd003d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.517740:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0a8c2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xe:0x0].0x5cd003d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.517748:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166754.517750:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0a8c2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xe:0x0].0x5cd003d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.517754:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0a8c2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xe:0x0].0x5cd003d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.517759:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe:0x0].0x5cd003d6 (ffff945bc477f200) 00010000:00010000:2.0:1762166754.517760:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166754.517761:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0a8c2 lrc: 2/0,0 mode: --/PR res: [0x200000403:0xe:0x0].0x5cd003d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.517765:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0a8c2 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xe:0x0].0x5cd003d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.517782:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1c00/0x2f180c4effb0a8b4 lrc: 1/0,0 mode: --/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b74d3 expref: 11 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166754.517787:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe:0x0].0x0 (ffff945cd1ddd400) 00010000:00010000:2.0:1762166754.517788:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166754.517790:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1c00/0x2f180c4effb0a8b4 lrc: 0/0,0 mode: --/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b74d3 expref: 11 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166754.517796:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b1c00, rc 0) 00000100:00100000:2.0:1762166754.517821:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4946300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+10:37063:x1847765439971712:12345-192.168.204.38@tcp:101:rm.0 Request processed in 232us (297us total) trans 0 rc 301/301 00000100:00100000:2.0:1762166754.517825:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2448 00000100:00100000:3.0:1762166754.523892:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166754.523948:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439971840 00000100:00100000:2.0:1762166754.523958:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439971840 00000100:00100000:2.0:1762166754.524023:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2449 00000100:00100000:2.0:1762166754.524033:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4944380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+10:37064:x1847765439971840:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166754.524071:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166754.524090:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0a8c9 lrc: 2/0,0 mode: --/CR res: [0x200000403:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b74da expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166754.524151:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1400/0x2f180c4effb0a8d0 lrc: 3/1,0 mode: --/CR res: [0x200000403:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.524164:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1400/0x2f180c4effb0a8d0 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.524176:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1400/0x2f180c4effb0a8d0 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.524191:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0a8d7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.524198:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0a8d7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.524205:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0a8d7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.524241:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1400/0x2f180c4effb0a8d0 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.524247:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1400/0x2f180c4effb0a8d0 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.524253:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1400/0x2f180c4effb0a8d0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.524259:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1400/0x2f180c4effb0a8d0 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.524271:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166754.524275:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1400/0x2f180c4effb0a8d0 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.524283:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1400/0x2f180c4effb0a8d0 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.524299:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe:0x0].0x0 (ffff945cd1ddd400) 00010000:00010000:2.0:1762166754.524302:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166754.524306:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1400/0x2f180c4effb0a8d0 lrc: 3/0,0 mode: --/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.524313:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1400/0x2f180c4effb0a8d0 lrc: 0/0,0 mode: --/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.524325:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0a8d7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.524331:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0a8d7 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.524336:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0a8d7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.524341:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166754.524343:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0a8d7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.524348:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0a8d7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.524354:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe:0x0].0xff6e0927 (ffff945bc477f600) 00010000:00010000:2.0:1762166754.524357:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166754.524365:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0a8d7 lrc: 2/0,0 mode: --/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.524370:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0a8d7 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.524401:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0a8c9 lrc: 1/0,0 mode: --/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b74da expref: 11 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166754.524410:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe:0x0].0x0 (ffff945cd1ddd400) 00010000:00010000:2.0:1762166754.524413:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166754.524416:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0a8c9 lrc: 0/0,0 mode: --/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b74da expref: 11 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166754.524426:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0600, rc 0) 00000100:00100000:2.0:1762166754.524503:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4944380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+10:37064:x1847765439971840:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 471us (620us total) trans 0 rc 301/301 00000100:00100000:2.0:1762166754.524515:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2449 00000100:00100000:1.0:1762166754.525835:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166754.525880:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439971968 00000100:00100000:2.0:1762166754.525886:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439971968 00000100:00100000:2.0:1762166754.525932:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2450 00000100:00100000:2.0:1762166754.525940:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+10:37064:x1847765439971968:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166754.525952:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166754.525963:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5000/0x2f180c4effb0a8de lrc: 2/0,0 mode: --/CR res: [0x200000403:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b74e1 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166754.526010:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5800/0x2f180c4effb0a8e5 lrc: 3/1,0 mode: --/CR res: [0x200000403:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.526021:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5800/0x2f180c4effb0a8e5 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.526060:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5800/0x2f180c4effb0a8e5 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.526074:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5400/0x2f180c4effb0a8ec lrc: 3/1,0 mode: --/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.526081:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5400/0x2f180c4effb0a8ec lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.526087:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5400/0x2f180c4effb0a8ec lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.526110:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5800/0x2f180c4effb0a8e5 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.526117:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5800/0x2f180c4effb0a8e5 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.526123:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5800/0x2f180c4effb0a8e5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.526130:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5800/0x2f180c4effb0a8e5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.526135:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb5800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166754.526138:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5800/0x2f180c4effb0a8e5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.526144:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5800/0x2f180c4effb0a8e5 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.526153:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe:0x0].0x0 (ffff945cd1ddd400) 00010000:00010000:2.0:1762166754.526156:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166754.526166:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5800/0x2f180c4effb0a8e5 lrc: 3/0,0 mode: --/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.526172:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5800/0x2f180c4effb0a8e5 lrc: 0/0,0 mode: --/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.526184:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5400/0x2f180c4effb0a8ec lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.526189:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5400/0x2f180c4effb0a8ec lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.526195:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5400/0x2f180c4effb0a8ec lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.526200:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb5400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166754.526203:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5400/0x2f180c4effb0a8ec lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.526208:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5400/0x2f180c4effb0a8ec lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.526216:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe:0x0].0xff6e0927 (ffff945bc477fb00) 00010000:00010000:2.0:1762166754.526219:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166754.526222:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5400/0x2f180c4effb0a8ec lrc: 2/0,0 mode: --/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.526227:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5400/0x2f180c4effb0a8ec lrc: 0/0,0 mode: --/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.526252:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5000/0x2f180c4effb0a8de lrc: 1/0,0 mode: --/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b74e1 expref: 11 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166754.526261:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe:0x0].0x0 (ffff945cd1ddd400) 00010000:00010000:2.0:1762166754.526268:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166754.526273:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5000/0x2f180c4effb0a8de lrc: 0/0,0 mode: --/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b74e1 expref: 11 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166754.526282:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cb5000, rc 0) 00000100:00100000:2.0:1762166754.526324:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+10:37064:x1847765439971968:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 385us (491us total) trans 0 rc 301/301 00000100:00100000:2.0:1762166754.526331:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2450 00000100:00100000:3.0:1762166754.528031:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166754.528105:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439972096 00000100:00100000:2.0:1762166754.528113:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439972096 00000100:00100000:2.0:1762166754.528156:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2451 00000100:00100000:2.0:1762166754.528165:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4945f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+10:37064:x1847765439972096:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166754.528179:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166754.528193:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5c00/0x2f180c4effb0a8f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b74e8 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166754.528254:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4600/0x2f180c4effb0a8fa lrc: 3/1,0 mode: --/PR res: [0x200000403:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.528266:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4600/0x2f180c4effb0a8fa lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.528275:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4600/0x2f180c4effb0a8fa lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:2.0:1762166754.528313:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0xe:0x0]: returning size 4096 00000004:00200000:2.0:1762166754.528317:0:7432:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166754.528335:0:7432:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4600/0x2f180c4effb0a8fa lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.528355:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5c00/0x2f180c4effb0a8f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b74e8 expref: 12 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166754.528383:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4600/0x2f180c4effb0a8fa lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b74e8 expref: 11 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166754.528390:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe:0x0].0x0 (ffff945cd1ddd400) 00010000:00010000:2.0:1762166754.528394:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1762166754.528397:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cb4600, rc 0) 00000100:00100000:2.0:1762166754.528444:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4945f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+11:37064:x1847765439972096:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 280us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166754.528451:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2451 00000100:00100000:3.0:1762166754.530497:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166754.530522:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439972224 00000100:00100000:2.0:1762166754.530528:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439972224 00000100:00100000:2.0:1762166754.530553:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2452 00000100:00100000:2.0:1762166754.530560:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4946680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+11:37064:x1847765439972224:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166754.530577:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166754.530589:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4200/0x2f180c4effb0a901 lrc: 2/0,0 mode: --/CR res: [0x200000403:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b74ef expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166754.530648:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4000/0x2f180c4effb0a908 lrc: 3/1,0 mode: --/CR res: [0x200000403:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.530658:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4000/0x2f180c4effb0a908 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.530664:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4000/0x2f180c4effb0a908 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.530675:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1c00/0x2f180c4effb0a90f lrc: 3/1,0 mode: --/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.530686:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1c00/0x2f180c4effb0a90f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.530691:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1c00/0x2f180c4effb0a90f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.530715:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4000/0x2f180c4effb0a908 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.530719:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4000/0x2f180c4effb0a908 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.530722:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4000/0x2f180c4effb0a908 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.530726:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4000/0x2f180c4effb0a908 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.530730:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb4000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166754.530732:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4000/0x2f180c4effb0a908 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.530736:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4000/0x2f180c4effb0a908 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.530742:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe:0x0].0x0 (ffff945cd1ddd400) 00010000:00010000:2.0:1762166754.530744:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166754.530746:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4000/0x2f180c4effb0a908 lrc: 3/0,0 mode: --/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.530750:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4000/0x2f180c4effb0a908 lrc: 0/0,0 mode: --/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.530756:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1c00/0x2f180c4effb0a90f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.530763:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1c00/0x2f180c4effb0a90f lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.530767:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1c00/0x2f180c4effb0a90f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.530769:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166754.530771:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1c00/0x2f180c4effb0a90f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.530774:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1c00/0x2f180c4effb0a90f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.530778:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe:0x0].0xff6e0927 (ffff945bc477f200) 00010000:00010000:2.0:1762166754.530779:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166754.530781:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1c00/0x2f180c4effb0a90f lrc: 2/0,0 mode: --/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.530784:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1c00/0x2f180c4effb0a90f lrc: 0/0,0 mode: --/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.530803:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4200/0x2f180c4effb0a901 lrc: 1/0,0 mode: --/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b74ef expref: 12 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166754.530808:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe:0x0].0x0 (ffff945cd1ddd400) 00010000:00010000:2.0:1762166754.530809:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166754.530811:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4200/0x2f180c4effb0a901 lrc: 0/0,0 mode: --/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b74ef expref: 12 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166754.530816:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cb4200, rc 0) 00000100:00100000:2.0:1762166754.530848:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4946680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+11:37064:x1847765439972224:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 289us (373us total) trans 0 rc 301/301 00000100:00100000:2.0:1762166754.530856:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2452 00000100:00100000:1.0:1762166754.532498:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166754.532525:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439972480 00000100:00100000:2.0:1762166754.532531:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439972480 00000100:00100000:2.0:1762166754.532557:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2453 00000100:00100000:2.0:1762166754.532564:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+11:37064:x1847765439972480:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166754.532572:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166754.532574:0:7432:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1762166754.532586:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4600/0x2f180c4effb0a8fa lrc: 0/0,0 mode: --/PR res: [0x200000403:0xe:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b74e8 expref: 11 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166754.532596:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe:0x0].0x0 (ffff945cd1ddd400) 00010000:00010000:2.0:1762166754.532598:0:7432:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166754.532604:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0a916 lrc: 2/0,0 mode: --/CW res: [0x200000403:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b74f6 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166754.532647:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0a91d lrc: 3/0,1 mode: --/CW res: [0x200000403:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.532654:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0a91d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.532659:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0a91d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.532666:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0a924 lrc: 3/0,1 mode: --/PW res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.532669:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0a924 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.532673:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0a924 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.532993:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1600/0x2f180c4effb0a92b lrc: 3/1,0 mode: --/PR res: [0x200000403:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.533002:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1600/0x2f180c4effb0a92b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.533008:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1600/0x2f180c4effb0a92b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:2.0:1762166754.533016:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0xf:0x0]: returning size 0 00010000:00010000:2.0:1762166754.533048:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0a91d lrc: 4/0,1 mode: CW/CW res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.533053:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0a91d lrc: 4/0,1 mode: CW/CW res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.533057:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0a91d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.533060:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0a91d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.533064:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166754.533066:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0a91d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.533070:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0a91d lrc: 5/0,0 mode: CW/CW res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.533075:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe:0x0].0x0 (ffff945cd1ddd400) 00010000:00010000:2.0:1762166754.533077:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166754.533078:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0a91d lrc: 3/0,0 mode: --/CW res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.533088:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0a91d lrc: 0/0,0 mode: --/CW res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00000004:00010000:2.0:1762166754.533096:0:7432:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000396ed8aa reply state 00000000efc4c1d6 transno 4294968788 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0a924 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.533102:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0a924 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.533106:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe:0x0].0xff6e0927 (ffff945bc477f800) 00010000:00010000:2.0:1762166754.533107:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166754.533109:0:7432:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1762166754.533124:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0a916 lrc: 0/0,0 mode: --/CW res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b74f6 expref: 13 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166754.533132:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1600/0x2f180c4effb0a92b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b74f6 expref: 12 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166754.533136:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf:0x0].0x0 (ffff945bc477f300) 00010000:00010000:2.0:1762166754.533138:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166754.533139:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b1600, rc 0) 00000100:00100000:2.0:1762166754.533170:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+13:37064:x1847765439972480:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 608us (676us total) trans 4294968788 rc 0/0 00000100:00100000:2.0:1762166754.533175:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2453 00000100:00100000:3.0:1762166754.534756:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166754.534788:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439972736 00000100:00100000:2.0:1762166754.534792:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439972736 00000100:00100000:2.0:1762166754.534819:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2454 00000100:00100000:2.0:1762166754.534825:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4947480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+13:37064:x1847765439972736:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166754.534835:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166754.534856:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9e400/0x2f180c4effb0a939 lrc: 2/0,0 mode: --/CR res: [0x200000403:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b74fd expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166754.534895:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9f600/0x2f180c4effb0a940 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.534902:0:7432:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1600/0x2f180c4effb0a92b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b74f6 expref: 14 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166754.534908:0:7432:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9f600/0x2f180c4effb0a940 lrc: 4/0,1 mode: --/EX res: [0x200000403:0xf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.534941:0:7432:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1600/0x2f180c4effb0a92b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b74f6 expref: 14 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166754.534955:0:7432:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1600/0x2f180c4effb0a92b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b74f6 expref: 14 pid: 7432 timeout: 473 lvb_type: 0 00000100:00100000:2.0:1762166754.534967:0:7432:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bbb480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765446773120:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166754.535042:0:7432:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1c86e40 going to sleep for 11 seconds 00000100:00100000:2.0:1762166754.535899:0:7432:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bbb480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765446773120:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166754.535912:0:7432:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9f600/0x2f180c4effb0a940 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000100:00100000:3.0:1762166754.536239:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166754.536292:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439972864 00000100:00100000:2.0:1762166754.536299:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439972864 00010000:00010000:2.0:1762166754.536328:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1600/0x2f180c4effb0a92b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b74f6 expref: 15 pid: 7432 timeout: 473 lvb_type: 0 00000100:00100000:2.0:1762166754.536359:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 566 00000100:00100000:2.0:1762166754.536372:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cceb4b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+15:2418:x1847765439972864:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166754.536391:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166754.536399:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1600/0x2f180c4effb0a92b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b74f6 expref: 15 pid: 7432 timeout: 473 lvb_type: 0 00010000:00010000:2.0:1762166754.536410:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1600/0x2f180c4effb0a92b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b74f6 expref: 15 pid: 7432 timeout: 473 lvb_type: 0 00010000:00010000:2.0:1762166754.536424:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1600/0x2f180c4effb0a92b lrc: 0/0,0 mode: --/PR res: [0x200000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b74f6 expref: 15 pid: 7432 timeout: 473 lvb_type: 0 00010000:00010000:2.0:1762166754.536434:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf:0x0].0x0 (ffff945bc477f300) 00010000:00010000:2.0:1762166754.536436:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9f600/0x2f180c4effb0a940 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.536441:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9f600/0x2f180c4effb0a940 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.536445:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9f600/0x2f180c4effb0a940 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0xf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166754.536463:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166754.536508:0:7432:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9f600/0x2f180c4effb0a940 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000100:00100000:2.0:1762166754.536513:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cceb4b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+14:2418:x1847765439972864:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 146us (281us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166754.536522:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9f600/0x2f180c4effb0a940 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000100:00100000:2.0:1762166754.536529:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 566 00000004:00200000:1.0:1762166754.536537:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0xf:0x0]: returning size 0 00000004:00080000:1.0:1762166754.536701:0:7432:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x39:0x0], index 1: 0 00000004:00080000:1.0:1762166754.536708:0:7432:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3c:0x0], index 0: 0 00000004:00080000:1.0:1762166754.536713:0:7432:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3a:0x0], index 1: 0 00000004:00080000:1.0:1762166754.536716:0:7432:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3d:0x0], index 0: 0 00010000:00010000:1.0:1762166754.536895:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9f600/0x2f180c4effb0a940 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.536903:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9f600/0x2f180c4effb0a940 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.536909:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9f600/0x2f180c4effb0a940 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.536914:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3c9f600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166754.536917:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9f600/0x2f180c4effb0a940 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.536923:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9f600/0x2f180c4effb0a940 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.536931:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf:0x0].0x0 (ffff945bc477f300) 00010000:00010000:1.0:1762166754.536934:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166754.536937:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9f600/0x2f180c4effb0a940 lrc: 2/0,0 mode: --/EX res: [0x200000403:0xf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.536952:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9f600/0x2f180c4effb0a940 lrc: 0/0,0 mode: --/EX res: [0x200000403:0xf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.536990:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9e400/0x2f180c4effb0a939 lrc: 1/0,0 mode: --/CR res: [0x200000403:0xe:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b74fd expref: 14 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166754.537006:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe:0x0].0x0 (ffff945cd1ddd400) 00010000:00010000:1.0:1762166754.537009:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1762166754.537013:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9e400/0x2f180c4effb0a939 lrc: 0/0,0 mode: --/CR res: [0x200000403:0xe:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b74fd expref: 14 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166754.537020:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3c9e400, rc 0) 00000100:00100000:1.0:1762166754.537076:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4947480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+13:37064:x1847765439972736:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2250us (2321us total) trans 4294968789 rc 301/301 00000100:00100000:1.0:1762166754.537083:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2454 00000100:00100000:3.0:1762166754.538240:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166754.538294:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439973120 00000100:00100000:2.0:1762166754.538299:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439973120 00000100:00100000:2.0:1762166754.538326:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 698 00000100:00100000:2.0:1762166754.538331:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7d29850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+13:37064:x1847765439973120:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1762166754.538522:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7d29850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+14:37064:x1847765439973120:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 187us (282us total) trans 4294968790 rc 0/0 00000100:00100000:2.0:1762166754.538538:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 698 00000100:00100000:3.0:1762166754.539372:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166754.539413:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439973376 00000100:00100000:2.0:1762166754.539418:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439973376 00000100:00100000:2.0:1762166754.539449:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 699 00000100:00100000:2.0:1762166754.539457:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4947100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+14:37064:x1847765439973376:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1762166754.539575:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4947100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+15:37064:x1847765439973376:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 120us (204us total) trans 4294968791 rc 0/0 00000100:00100000:2.0:1762166754.539583:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 699 00000100:00100000:3.0:1762166754.548208:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166754.548343:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439973632 00000100:00100000:1.0:1762166754.548353:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439973632 00000100:00100000:1.0:1762166754.548411:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2455 00000100:00100000:1.0:1762166754.548423:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4945180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+15:37066:x1847765439973632:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166754.548445:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166754.548463:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0a94e lrc: 2/0,0 mode: --/CR res: [0x200000403:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7504 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166754.548549:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0a955 lrc: 3/1,0 mode: --/CR res: [0x200000403:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.548562:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0a955 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.548594:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0a955 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.548607:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0a95c lrc: 3/1,0 mode: --/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.548614:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0a95c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.548619:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0a95c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.548691:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0a955 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.548698:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0a955 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.548703:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0a955 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.548709:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0a955 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.548715:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786b200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166754.548719:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0a955 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.548726:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0a955 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.548737:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe:0x0].0x0 (ffff945cd1ddd400) 00010000:00010000:1.0:1762166754.548740:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166754.548751:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0a955 lrc: 3/0,0 mode: --/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.548757:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0a955 lrc: 0/0,0 mode: --/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.548769:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0a95c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.548775:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0a95c lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.548781:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0a95c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.548786:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786a200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166754.548788:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0a95c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.548794:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0a95c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.548800:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe:0x0].0xff6e0927 (ffff945bc477f800) 00010000:00010000:1.0:1762166754.548803:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166754.548806:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0a95c lrc: 2/0,0 mode: --/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.548812:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0a95c lrc: 0/0,0 mode: --/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.548838:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0a94e lrc: 1/0,0 mode: --/CR res: [0x200000403:0xe:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7504 expref: 16 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166754.548848:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe:0x0].0x0 (ffff945cd1ddd400) 00010000:00010000:1.0:1762166754.548856:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1762166754.548861:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0a94e lrc: 0/0,0 mode: --/CR res: [0x200000403:0xe:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7504 expref: 16 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166754.548871:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf786aa00, rc 0) 00000100:00100000:1.0:1762166754.548928:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4945180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+15:37066:x1847765439973632:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 508us (800us total) trans 0 rc 301/301 00000100:00100000:1.0:1762166754.548936:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2455 00000100:00100000:3.0:1762166754.550222:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166754.550265:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439973888 00000100:00100000:1.0:1762166754.550272:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439973888 00000100:00100000:1.0:1762166754.550304:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2456 00000100:00100000:1.0:1762166754.550313:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4944700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+15:37066:x1847765439973888:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166754.550324:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166754.550336:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0a963 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b750b expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1762166754.550411:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0xe:0x0]: returning size 4096 00010000:00010000:1.0:1762166754.550511:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0a963 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b750b expref: 17 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166754.550522:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:1.0:1762166754.550525:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1762166754.550528:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0a963 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b750b expref: 17 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166754.550539:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf786b000, rc 0) 00000100:00100000:1.0:1762166754.550572:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4944700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+16:37066:x1847765439973888:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 260us (379us total) trans 4294968792 rc 301/301 00000100:00100000:1.0:1762166754.550588:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2456 00000100:00100000:3.0:1762166754.551543:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166754.551569:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439974016 00000100:00100000:1.0:1762166754.551577:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439974016 00000100:00100000:1.0:1762166754.551599:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2457 00000100:00100000:1.0:1762166754.551605:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4944e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+16:37066:x1847765439974016:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:1.0:1762166754.551635:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0a971 lrc: 3/1,0 mode: --/CR res: [0x200000403:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.551643:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0a971 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.551650:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0a971 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.551656:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0a978 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.551660:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0a978 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.551664:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0a978 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.551699:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0a97f lrc: 3/1,0 mode: --/PR res: [0x200000403:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.551703:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0a97f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.551707:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0a97f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:1.0:1762166754.551727:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0xf:0x0]: returning size 0 00000004:00200000:1.0:1762166754.551734:0:7432:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166754.551741:0:7432:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0a97f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.551749:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0a971 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.551753:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0a971 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.551756:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0a971 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.551760:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0a971 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.551763:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786ae00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166754.551765:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0a971 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.551768:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0a971 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.551773:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe:0x0].0x0 (ffff945cd1ddd400) 00010000:00010000:1.0:1762166754.551775:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166754.551777:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0a971 lrc: 3/0,0 mode: --/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.551780:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0a971 lrc: 0/0,0 mode: --/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.551786:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0a978 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.551790:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0a978 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.551797:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0a978 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.551800:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786b600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166754.551801:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0a978 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.551805:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0a978 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.551808:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe:0x0].0xff6e0927 (ffff945bc477f800) 00010000:00010000:1.0:1762166754.551810:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166754.551812:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0a978 lrc: 2/0,0 mode: --/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.551814:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0a978 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.551819:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0a97f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.551822:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0a97f lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.551825:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0a97f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.551827:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786be00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166754.551829:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0a97f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.551832:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0a97f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.551839:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf:0x0].0x0 (ffff945cc9b89900) 00010000:00010000:1.0:1762166754.551840:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166754.551842:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0a97f lrc: 2/0,0 mode: --/PR res: [0x200000403:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.551845:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0a97f lrc: 0/0,0 mode: --/PR res: [0x200000403:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00000100:00100000:1.0:1762166754.551883:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4944e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+16:37066:x1847765439974016:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 277us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166754.551887:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2457 00000100:00100000:3.0:1762166754.554629:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166754.554729:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439974272 00000100:00100000:2.0:1762166754.554736:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439974272 00000100:00100000:2.0:1762166754.554796:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 700 00000100:00100000:2.0:1762166754.554808:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4945500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+16:37066:x1847765439974272:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1762166754.555029:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4945500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+17:37066:x1847765439974272:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 224us (429us total) trans 4294968793 rc 0/0 00000100:00100000:2.0:1762166754.555060:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 700 00000100:00100000:3.0:1762166754.562505:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166754.562577:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439974528 00000100:00100000:1.0:1762166754.562586:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439974528 00000100:00100000:1.0:1762166754.562633:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2458 00000100:00100000:1.0:1762166754.562644:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4944000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+17:37068:x1847765439974528:12345-192.168.204.38@tcp:101:dd.0 00010000:00010000:1.0:1762166754.562665:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166754.562688:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0a986 lrc: 2/0,0 mode: --/CW res: [0x200000403:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7512 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166754.562808:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0a98d lrc: 3/1,0 mode: --/CR res: [0x200000403:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.562820:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0a98d lrc: 3/1,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.562830:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0a98d lrc: 3/1,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.562840:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0a994 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.562855:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0a994 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.562861:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0a994 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.562915:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0a99b lrc: 3/1,0 mode: --/PR res: [0x200000403:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.562923:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0a99b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.562929:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0a99b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:1.0:1762166754.562938:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0xf:0x0]: returning size 0 00010000:00010000:1.0:1762166754.563008:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0a98d lrc: 4/1,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.563015:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0a98d lrc: 4/1,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.563020:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0a98d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.563025:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0a98d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.563030:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786b600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166754.563033:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0a98d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.563052:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0a98d lrc: 5/0,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.563079:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe:0x0].0x0 (ffff945cd1ddd400) 00010000:00010000:1.0:1762166754.563082:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166754.563087:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0a98d lrc: 3/0,0 mode: --/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.563092:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0a98d lrc: 0/0,0 mode: --/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.563110:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0a994 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.563116:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0a994 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.563121:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0a994 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.563126:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786ae00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166754.563129:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0a994 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.563134:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0a994 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.563142:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe:0x0].0xff6e0927 (ffff945bc477f800) 00010000:00010000:1.0:1762166754.563144:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166754.563148:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0a994 lrc: 2/0,0 mode: --/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.563151:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0a994 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.563178:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0a986 lrc: 0/0,0 mode: --/CW res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7512 expref: 20 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166754.563192:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0a99b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7512 expref: 19 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166754.563196:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf:0x0].0x0 (ffff945cc9b89900) 00010000:00010000:1.0:1762166754.563198:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166754.563199:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf786b000, rc 0) 00000100:00100000:1.0:1762166754.563248:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4944000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+19:37068:x1847765439974528:12345-192.168.204.38@tcp:101:dd.0 Request processed in 606us (776us total) trans 4294968794 rc 0/0 00000100:00100000:1.0:1762166754.563255:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2458 00000100:00100000:3.0:1762166754.575644:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166754.575721:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439974784 00000100:00100000:1.0:1762166754.575731:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439974784 00000100:00100000:1.0:1762166754.575783:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2459 00000100:00100000:1.0:1762166754.575793:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+19:37068:x1847765439974784:12345-192.168.204.38@tcp:101:dd.0 00010000:00010000:1.0:1762166754.575815:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166754.575819:0:7432:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1762166754.575843:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0a99b lrc: 0/0,0 mode: --/PR res: [0x200000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7512 expref: 19 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166754.575861:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf:0x0].0x0 (ffff945cc9b89900) 00010000:00010000:1.0:1762166754.575872:0:7432:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166754.575886:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0a9a9 lrc: 2/0,0 mode: --/EX res: [0x200000403:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7519 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166754.575930:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0a9b0 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.575941:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0a9b0 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xf:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166754.575967:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0a9b0 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xf:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000040:00080000:1.0:1762166754.576242:0:7432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].92, 88 off15688 00000004:00080000:1.0:1762166754.576251:0:7432:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 373724773206ns, next at 369156951493ns, rc = 0 00000040:00080000:1.0:1762166754.576301:0:7432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].96, 88 off16016 00000004:00080000:1.0:1762166754.576309:0:7432:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 373724830758ns, next at 372167105368ns, rc = 0 00000040:00080000:1.0:1762166754.576334:0:7432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].93, 88 off15776 00000004:00080000:1.0:1762166754.576340:0:7432:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 373724861810ns, next at 369156951493ns, rc = 0 00000040:00080000:1.0:1762166754.576365:0:7432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].97, 88 off16104 00000004:00080000:1.0:1762166754.576371:0:7432:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 373724892615ns, next at 372167105368ns, rc = 0 00000001:00080000:3.0:1762166754.577537:0:6475:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968795 is committed 00000004:00080000:3.0:1762166754.577543:0:6475:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 93 committed 00000004:00080000:3.0:1762166754.577556:0:6475:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 86 committed 00000004:00080000:3.0:1762166754.577565:0:6475:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 92 committed 00000004:00080000:3.0:1762166754.577568:0:6475:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 85 committed 00010000:00010000:0.0:1762166754.577589:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0a924 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166754.577600:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0a924 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166754.577609:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0a924 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166754.577617:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166754.577622:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0a924 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166754.577630:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0a924 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00000100:00100000:3.0:1762166754.577635:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446773248:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1762166754.577644:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe:0x0].0xff6e0927 (ffff945bc477f800) 00010000:00010000:0.0:1762166754.577649:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166754.577654:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0a924 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166754.577661:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0a924 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00000100:00100000:1.0:1762166754.577665:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446773632:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762166754.577681:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446773376:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1762166754.577698:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166754.577705:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1e6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446773504:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1762166754.577730:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0a9b0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0xf:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7519 expref: 12 pid: 7432 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166754.577734:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1762166754.577746:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf:0x0].0x0 (ffff945cc9b89b00) 00010000:00010000:1.0:1762166754.577750:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000100:00100000:0.0:1762166754.577754:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1762166754.577766:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0a9a9 lrc: 0/0,0 mode: --/EX res: [0x200000403:0xf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7519 expref: 12 pid: 7432 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1762166754.577781:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0a9b0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0xf:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7519 expref: 11 pid: 7432 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166754.577791:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446773760:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1762166754.577800:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf:0x0].0x0 (ffff945cc9b89b00) 00010000:00010000:1.0:1762166754.577803:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1762166754.577805:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf786ae00, rc 0) 00000100:00100000:0.0:1762166754.577808:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446773248 00000100:00100000:0.0:1762166754.577813:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446773248 00000100:00100000:2.0:1762166754.577824:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166754.577827:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166754.577848:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+11:37068:x1847765439974784:12345-192.168.204.38@tcp:101:dd.0 Request processed in 2056us (2212us total) trans 4294968795 rc 0/0 00000100:00100000:1.0:1762166754.577861:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2459 00000100:00100000:0.0:1762166754.577861:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446773376 00000100:00100000:2.0:1762166754.577863:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446773504 00000100:00100000:2.0:1762166754.577868:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446773504 00000100:00100000:0.0:1762166754.577868:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446773376 00000100:00100000:0.0:1762166754.577906:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446773632 00000100:00100000:2.0:1762166754.577907:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446773760 00000100:00100000:2.0:1762166754.577911:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446773760 00000100:00100000:0.0:1762166754.577911:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446773632 00000100:00100000:1.0:1762166754.577912:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 868 00000100:00100000:1.0:1762166754.577923:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3635:x1847765446773248:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762166754.577934:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 869 00000100:00100000:0.0:1762166754.577942:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 870 00000100:00100000:2.0:1762166754.577948:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3636:x1847765446773376:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1762166754.577955:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:3633:x1847765446773504:12345-0@lo:2:osp-syn-0-0.0 00002000:00080000:2.0:1762166754.577972:0:9168:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:56 count 1 00010000:00010000:2.0:1762166754.577992:0:9168:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9ec00/0x2f180c4effb0a9b7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166754.578007:0:9168:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1800/0x2f180c4effb0a42a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x38:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b738a expref: 7 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166754.578012:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166754.578014:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166754.578017:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9ec00/0x2f180c4effb0a9b7 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166754.578049:0:9168:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1800/0x2f180c4effb0a42a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x38:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b738a expref: 7 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166754.578063:0:9168:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1800/0x2f180c4effb0a42a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x38:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b738a expref: 7 pid: 28874 timeout: 473 lvb_type: 1 00000100:00100000:2.0:1762166754.578075:0:9168:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc558a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9168:1847765446773888:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166754.578116:0:9168:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4033c00 going to sleep for 11 seconds 00000100:00100000:2.0:1762166754.578134:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 871 00000100:00100000:2.0:1762166754.578140:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3635:x1847765446773760:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762166754.578148:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:3633:x1847765446773504:12345-0@lo:2:osp-syn-0-0.0 Request processed in 195us (395us total) trans 21474836635 rc 0/0 00000100:00100000:1.0:1762166754.578149:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:3635:x1847765446773248:12345-0@lo:2:osp-syn-0-0.0 Request processed in 226us (450us total) trans 21474836636 rc 0/0 00000100:00100000:0.0:1762166754.578163:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 870 00000100:00100000:1.0:1762166754.578170:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 868 00000100:00100000:0.0:1762166754.578184:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 872 00000100:00100000:0.0:1762166754.578194:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3e68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:3634:x1847765446773632:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1762166754.578218:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc406d500/2, rc 0, transno 21474836636 00000100:00100000:1.0:1762166754.578226:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446773248:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762166754.578300:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3635:x1847765446773760:12345-0@lo:2:osp-syn-1-0.0 Request processed in 159us (477us total) trans 17179869315 rc 0/0 00000100:00100000:2.0:1762166754.578308:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 871 00000004:00080000:1.0:1762166754.578327:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5bba680/2, rc 0, transno 17179869315 00000100:00100000:0.0:1762166754.578331:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3e68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:3634:x1847765446773632:12345-0@lo:2:osp-syn-1-0.0 Request processed in 136us (508us total) trans 17179869316 rc 0/0 00000100:00100000:1.0:1762166754.578336:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446773760:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762166754.578343:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 872 00000004:00080000:3.0:1762166754.578348:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5bbb480/2, rc 0, transno 17179869316 00000100:00100000:3.0:1762166754.578355:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446773632:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1762166754.578386:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf1e6c700/2, rc 0, transno 21474836635 00000100:00100000:0.0:1762166754.578391:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1e6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446773504:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762166754.578590:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1762166754.578602:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446774016:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1762166754.578612:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3db6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446774144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1762166754.578637:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166754.578668:0:8385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446774016 00000100:00100000:1.0:1762166754.578674:0:8385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446774016 00000100:00100000:0.0:1762166754.578679:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166754.578713:0:8385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446774144 00000100:00100000:1.0:1762166754.578717:0:8385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446774144 00000100:00100000:2.0:1762166754.578719:0:12247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1762166754.578731:0:12247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3635:x1847765446774016:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1762166754.578738:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1762166754.578750:0:8384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3633:x1847765446774144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1762166754.578754:0:12247:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 31883840 pending 0 free 3922444288 avail 3690921984 00002000:00000024:3.0:1762166754.578764:0:8384:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 31883840 pending 0 free 3922444288 avail 3690921984 00000100:00100000:2.0:1762166754.578798:0:12247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3635:x1847765446774016:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166754.578806:0:12247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1762166754.578822:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446774016:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1762166754.578827:0:8384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3633:x1847765446774144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166754.578837:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1762166754.578847:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3db6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446774144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1762166754.579096:0:9168:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc558a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9168:1847765446773888:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166754.579111:0:9168:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9ec00/0x2f180c4effb0a9b7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166754.579301:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166754.579338:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439974912 00000100:00100000:2.0:1762166754.579341:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439974912 00010000:00010000:2.0:1762166754.579366:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1800/0x2f180c4effb0a42a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x38:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b738a expref: 8 pid: 28874 timeout: 473 lvb_type: 1 00000100:00080000:1.0:1762166754.579382:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1762166754.579387:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 567 00000100:00100000:2.0:1762166754.579393:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+8:2418:x1847765439974912:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166754.579401:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166754.579404:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1800/0x2f180c4effb0a42a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x38:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b738a expref: 8 pid: 28874 timeout: 473 lvb_type: 1 00010000:00010000:2.0:1762166754.579413:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1800/0x2f180c4effb0a42a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x38:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b738a expref: 8 pid: 28874 timeout: 473 lvb_type: 1 00010000:00010000:2.0:1762166754.579423:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1800/0x2f180c4effb0a42a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x38:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b738a expref: 8 pid: 28874 timeout: 473 lvb_type: 1 00010000:00010000:2.0:1762166754.579439:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166754.579441:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166754.579444:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9ec00/0x2f180c4effb0a9b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166754.579449:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9ec00/0x2f180c4effb0a9b7 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166754.579466:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166754.579513:0:9168:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9ec00/0x2f180c4effb0a9b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166754.579515:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+7:2418:x1847765439974912:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 119us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166754.579532:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 567 00010000:00010000:0.0:1762166754.579544:0:9168:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9ec00/0x2f180c4effb0a9b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166754.579553:0:9168:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9ec00/0x2f180c4effb0a9b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166754.579560:0:9168:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9ec00/0x2f180c4effb0a9b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166754.579583:0:9168:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166754.579602:0:6483:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166754.579609:0:6483:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9ec00/0x2f180c4effb0a9b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166754.579618:0:6483:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3c9ec00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166754.579623:0:6483:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9ec00/0x2f180c4effb0a9b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166754.579630:0:6483:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9ec00/0x2f180c4effb0a9b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166754.579643:0:6483:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9ec00/0x2f180c4effb0a9b7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166754.579650:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9ec00/0x2f180c4effb0a9b7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166754.579676:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166754.579679:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166754.579682:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166754.579749:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3636:x1847765446773376:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1805us (2024us total) trans 17179869317 rc 0/0 00000100:00100000:0.0:1762166754.579756:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 869 00000004:00080000:1.0:1762166754.579791:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5bb8700/2, rc 0, transno 17179869317 00000100:00100000:1.0:1762166754.579800:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446773376:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1762166754.586296:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166754.586354:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439975168 00000100:00100000:2.0:1762166754.586364:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439975168 00000100:00100000:2.0:1762166754.586431:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 701 00000100:00100000:2.0:1762166754.586442:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+11:37068:x1847765439975168:12345-192.168.204.38@tcp:35:dd.0 00000100:00100000:2.0:1762166754.586720:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+12:37068:x1847765439975168:12345-192.168.204.38@tcp:35:dd.0 Request processed in 280us (433us total) trans 4294968796 rc 0/0 00000100:00100000:2.0:1762166754.586730:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 701 00000001:02000400:3.0:1762166755.062614:0:29740:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-flr test_44a: @@@@@@ FAIL: writing /mnt/lustre/d44a.sanity-flr/f44a.sanity-flr failed 00010000:00010000:3.0:1762166755.090622:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762166755.091630:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1762166755.091651:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1e6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446774272:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1762166755.091790:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166755.091839:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446774272 00000100:00100000:1.0:1762166755.091849:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446774272 00000100:00100000:1.0:1762166755.091894:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 547 00000100:00100000:1.0:1762166755.091906:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3633:x1847765446774272:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1762166755.091943:0:6499:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446051840 avail 1299812352 00000100:00100000:1.0:1762166755.092007:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3633:x1847765446774272:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166755.092038:0:3633:0:(client.c:3071:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294968787 gen 2 00000004:00080000:2.0:1762166755.092045:0:3633:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294968785 committed transno 4294968787 00000004:00080000:2.0:1762166755.092064:0:3633:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294968787 committed transno 4294968787 00000100:00100000:2.0:1762166755.092135:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1e6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446774272:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1762166755.092135:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 547 Debug log: 4441 lines, 4441 kept, 0 dropped, 0 bad.